-- Logs begin at Wed 2022-05-25 14:23:22 UTC, end at Wed 2022-05-25 15:30:14 UTC. -- May 25 15:01:58.143783 dv-osbrick-830800-16-ceph systemd[1]: Starting Devstack devstack@keystone.service... May 25 15:01:58.154268 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 25 15:01:58.154878 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 15:01:58 2022] *** May 25 15:01:58.154878 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 15:01:58.154878 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 15:01:58.154878 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: nodename: dv-osbrick-830800-16-ceph May 25 15:01:58.154878 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: machine: x86_64 May 25 15:01:58.154878 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: clock source: unix May 25 15:01:58.154878 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: pcre jit disabled May 25 15:01:58.154878 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: detected number of CPU cores: 4 May 25 15:01:58.154878 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: current working directory: / May 25 15:01:58.154878 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: detected binary path: /usr/bin/uwsgi-core May 25 15:01:58.154878 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: your processes number limit is 47680 May 25 15:01:58.154878 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: your memory page size is 4096 bytes May 25 15:01:58.154878 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: detected max file descriptor number: 2048 May 25 15:01:58.154878 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: lock engine: pthread robust mutexes May 25 15:01:58.154878 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: thunder lock: enabled May 25 15:01:58.154878 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 25 15:01:58.156461 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 15:01:58.202437 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: Python main interpreter initialized at 0x55f5a740e9c0 May 25 15:01:58.202437 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: python threads support enabled May 25 15:01:58.202437 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: your server socket listen backlog is limited to 100 connections May 25 15:01:58.202437 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: your mercy for graceful operations on workers is 90 seconds May 25 15:01:58.202840 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: mapped 403077 bytes (393 KB) for 2 cores May 25 15:01:58.202840 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: *** Operational MODE: preforking *** May 25 15:01:58.203138 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: *** uWSGI is running in multiple interpreter mode *** May 25 15:01:58.203138 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: spawned uWSGI master process (pid: 87261) May 25 15:01:58.203326 dv-osbrick-830800-16-ceph systemd[1]: Started Devstack devstack@keystone.service. May 25 15:01:58.210287 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: spawned uWSGI worker 1 (pid: 87272, cores: 1) May 25 15:01:58.210287 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: spawned uWSGI worker 2 (pid: 87273, cores: 1) May 25 15:01:58.210287 dv-osbrick-830800-16-ceph devstack@keystone.service[87261]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 15:02:03.892450 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:02:03.892450 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: from cryptography.utils import int_from_bytes May 25 15:02:03.893295 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:02:03.893295 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: from cryptography.utils import int_from_bytes May 25 15:02:03.893744 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:02:03.893744 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: from cryptography.utils import int_from_bytes May 25 15:02:03.894270 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:02:03.894270 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: from cryptography.utils import int_from_bytes May 25 15:02:03.941462 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 15:02:03.941668 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 15:02:03.941838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] command line args: [] {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 15:02:03.942109 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 15:02:03.942259 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ================================================================================ {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 15:02:03.942554 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] admin_token = **** {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.942774 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 15:02:03.942905 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] config_dir = [] {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.942989 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 15:02:03.943057 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.943120 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] config_source = [] {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.943176 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] command line args: [] {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 15:02:03.943308 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] debug = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.943430 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 15:02:03.943512 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.943778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ================================================================================ {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 15:02:03.943778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] admin_token = **** {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.943895 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.944011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.944094 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] config_dir = [] {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.944197 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.944269 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.944424 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] config_source = [] {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.944544 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.944659 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] debug = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.944744 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] list_limit = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.944877 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.945050 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] log_config_append = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.945050 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.945204 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.945276 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] log_dir = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.945340 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.945398 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] log_file = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.945550 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.945634 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.945784 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.945989 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.946105 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] list_limit = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.946278 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.946409 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] log_config_append = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.946510 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.946584 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.946642 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.946700 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] log_dir = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.946762 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.946826 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] log_file = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.946887 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.946951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.947134 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.947262 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.947344 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.947464 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.947580 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.947704 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.947836 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.947910 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.948027 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.948109 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.948186 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.948389 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.948512 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.948596 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.948669 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.948897 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.949033 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.949404 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.949551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.949655 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.949775 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] publish_errors = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.949874 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.949975 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.950074 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.950168 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.950168 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.950428 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.950555 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.950639 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.950710 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.950855 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] standard_threads = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.951038 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] publish_errors = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.951132 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.951268 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.951344 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.951422 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.951493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.951569 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.951640 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] use_journal = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.951718 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.951790 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] use_json = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.951957 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] use_stderr = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.952078 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.952157 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] use_syslog = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.952229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] standard_threads = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.952309 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.952381 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.952594 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.952716 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.952793 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.952874 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.952947 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] use_journal = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.953054 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.953152 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] use_json = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.953314 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] use_stderr = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.953445 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.953526 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] use_syslog = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.953597 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.953693 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:02:03.953786 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.953983 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.954105 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.954183 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.954293 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.954494 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.954698 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.954781 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.954853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.954950 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.955033 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.955210 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.955349 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.955430 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.955508 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.955674 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.955796 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.955892 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.955971 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.956149 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.956272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.956349 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.956431 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.956622 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.956752 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.956885 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.956971 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.957052 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.957128 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.957317 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.957949 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.958057 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.958139 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.958139 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.958305 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.958399 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.958475 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.958550 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.958621 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.958621 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.958801 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.958886 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.958959 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.959029 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.959098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.959167 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.959244 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.959413 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.959537 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.959648 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.959732 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.959887 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.959979 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.960238 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.960315 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.960392 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.960533 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.960710 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.960784 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.960863 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.960934 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.961090 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.961172 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.961321 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.961402 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.961563 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.961645 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.961794 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.961882 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.962019 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.962106 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.962253 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.962347 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.962492 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.962573 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.962727 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.962808 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.962958 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.963040 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.963203 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.963291 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.963430 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.963520 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.963663 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.963750 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.963891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.963979 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.964121 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.964211 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.964350 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.964431 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.964593 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.964673 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.964816 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.964911 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.965036 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.965160 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.965262 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.965331 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.965493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.965597 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.965727 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.965811 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.965960 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.966043 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.966187 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.966370 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.966451 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.966519 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.966679 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.966754 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.966911 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.966995 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.967141 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.967229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.967378 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.967460 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.967615 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.967693 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.967842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.967926 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.968076 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.968154 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.968309 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.968391 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.968542 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.968628 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.968796 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.968873 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.969034 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.969114 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.969270 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.969353 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.969501 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.969594 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.969730 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.969813 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.969961 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.970045 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.970201 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.970312 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.970459 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.970538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.970692 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.970777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.970930 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.971007 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.971162 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.971239 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.971394 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.971547 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.971620 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.971690 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.971841 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.971926 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.972072 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.972157 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.972324 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.972400 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.972561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.972645 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.972797 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.972880 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.973028 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.973104 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.973262 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.973338 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.973492 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.973574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.973722 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.973799 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.973954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.974030 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.974181 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.974290 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.974443 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.974536 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.974670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.974748 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.974900 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.974976 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.975139 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.975215 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.975374 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.975449 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.975618 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.975709 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.975864 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.975971 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.976100 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.976238 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.976336 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.976501 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.976596 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.976773 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.976852 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.977016 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.977094 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.977248 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] auth.external = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.977333 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.977478 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.977555 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.977734 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.977811 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.977991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.978075 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.978221 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] auth.password = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.978346 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.978458 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] auth.token = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.978541 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] auth.external = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.978699 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.978778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.978932 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.979019 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.979177 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.979255 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.979405 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.979482 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] auth.password = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.979650 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.979737 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] auth.token = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.979896 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.979974 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.980123 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.980202 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.980356 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] credential.caching = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.980442 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.980590 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.980673 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.980836 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.980914 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.981080 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.981160 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.981310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.981387 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.981546 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.981625 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] credential.caching = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.981780 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.981859 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.982030 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.982107 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.982302 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.982395 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.982536 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.982792 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.982869 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.983043 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.983120 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.983285 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.983371 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.983556 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.983633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.983793 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.983880 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.984035 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.984120 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.984265 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] federation.caching = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.984342 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.984498 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.984576 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.984741 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.984833 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.984984 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.985063 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.985212 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.985289 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.985455 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.985612 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.985688 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.985759 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] federation.caching = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.985920 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.985999 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.986151 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.986279 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.986426 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.986505 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.986658 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.986736 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.986901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.986991 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.987131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] identity.caching = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.987210 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.987377 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.987455 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.987617 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.987704 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.987847 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.987924 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.988077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.988155 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.988323 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.988409 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.988557 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] identity.caching = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.988634 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.988791 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.988867 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.989057 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.989156 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.989274 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.989352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.989505 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.989583 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.989736 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.989823 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.989965 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.990043 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.990205 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.990306 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.990474 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.990568 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.990719 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.990799 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.990952 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.991029 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.991187 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.991308 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.991493 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.991724 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.991804 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.991982 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.992074 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.992233 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.992312 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.992501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.992580 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.992739 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.992824 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.992977 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.993055 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.993212 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.993291 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.993458 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.993572 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.993702 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.993800 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.993935 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.994014 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.994163 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.994295 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.994428 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.994506 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.994673 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.994749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.994907 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.994998 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.995151 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.995229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.995382 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.995459 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.995611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.995696 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.995846 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.995931 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.996072 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.996151 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.996307 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.996393 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.996538 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.996617 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.996778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.996854 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.997009 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.997093 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.997238 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.997316 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.997477 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.997555 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.997716 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.997801 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.997943 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.998068 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.998161 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.998285 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.998428 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.998510 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.998674 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.998753 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.998905 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.998983 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.999135 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.999221 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.999367 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.999445 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.999593 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.user = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.999671 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.999831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:03.999917 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.000082 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.000161 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.000309 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.000385 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.000542 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.000629 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.000776 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.user = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.000854 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.001021 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.001099 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.001251 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.001336 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.001480 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.001558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.001713 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.001794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.001944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.002030 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.002176 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.002283 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.002428 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.002508 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.002685 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.002772 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.002925 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.003002 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.003161 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.003238 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.003399 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.003486 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.003633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.003711 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.003861 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.003938 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.004107 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.004187 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.004341 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.004419 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.004574 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.004652 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.004808 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.004888 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.005039 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.005117 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.005280 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.005358 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.005526 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.005604 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.005757 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.005839 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.005995 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.006072 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.006226 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.006335 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.006487 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.006567 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.006719 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.006797 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.007002 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.007090 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.007243 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.007328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.007490 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.007568 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.007730 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.007810 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.007960 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.008039 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.008194 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.008272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.008435 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] resource.caching = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.008516 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.008682 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.008761 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.008928 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.009006 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.009163 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.009243 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.009402 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.009478 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.009650 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] resource.caching = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.009729 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.009880 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.009959 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.010129 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.010208 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.010386 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.010466 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.010623 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.010704 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.010855 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] role.caching = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.010933 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.011100 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] role.driver = sql {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.011184 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.011328 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.011408 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.011572 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.011649 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.011814 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.011891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.012052 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] role.caching = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.012137 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.012293 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.012370 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] role.driver = sql {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.012523 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.012599 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.012766 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.012844 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.013014 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.013092 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.013260 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.013338 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.013488 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.013568 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.013733 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.013811 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.013976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.014054 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.014220 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.014346 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.014485 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.014564 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.014733 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.014896 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.014977 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.015129 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.015208 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.015378 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.015457 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.015628 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.015708 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.015876 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.016087 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.016165 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.016334 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.016429 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.016581 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.016659 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.016831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.016909 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.017067 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.017153 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.017297 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.017376 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.017538 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.017616 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.017769 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.017854 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.018017 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.018096 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.018291 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.018374 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.018533 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.018621 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.018766 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.018854 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.018998 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.019076 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.019225 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.019311 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.019462 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] token.caching = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.019569 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.019695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.019785 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.019939 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.020027 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.020172 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.020250 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.020408 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.020485 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.020647 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] token.caching = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.020732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.020877 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.020954 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.021118 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.021196 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.021353 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.021438 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.021594 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.021671 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.021826 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.021904 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.022057 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.022143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.022313 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.022396 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.022603 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.022686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.022860 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.022972 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.023095 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.023222 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.023302 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.023465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.023596 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.023705 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.023861 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] database.connection = **** {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.023948 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.024102 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.024182 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.024348 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.024426 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.024582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.024662 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.024820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.024932 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.025055 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.025198 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] database.connection = **** {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.025289 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.025447 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.025527 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.025699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.025778 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.025939 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.026017 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.026177 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.026284 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.026442 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.026521 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.026673 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.026752 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.026910 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.026989 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.027142 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.027219 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.027384 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.027462 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.027608 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.027685 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.027839 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.027919 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.028069 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.028148 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.028227 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 15:02:04.028300 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.028542 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.028803 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.029042 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.029286 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.029526 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:02:04.029702 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 15:02:04.059920 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.060118 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.060185 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.060356 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.060510 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.060603 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.069329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.069603 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.097566 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.097767 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.098282 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.098526 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.151945 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.152125 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.205491 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.205699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.208932 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.209142 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.271794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.272011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.272085 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.272199 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.272291 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.272411 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.272631 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.272631 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.272773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.272833 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.272892 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.273083 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.298524 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.298757 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.298847 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.298912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.298972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.299154 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.299278 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.299347 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.299408 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.299602 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.299743 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.299815 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.299891 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.299999 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.311427 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.311673 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.324440 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.324705 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.324908 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.325147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.325271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.325376 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.325456 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.325530 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.325647 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.325738 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87273) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.325864 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.326110 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.326359 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.326579 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87272) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:02:04.343061 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.343303 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 15:02:04.343638 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.343834 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 15:02:04.343971 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.344056 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 15:02:04.344138 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.344336 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.344461 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.344542 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 15:02:04.344772 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.344898 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.344979 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.345066 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.345486 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.345752 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.355839 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.356108 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.356372 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.356645 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.357225 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.357505 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.357774 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.358054 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.364848 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.366712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.368846 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.369131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.369410 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.369685 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.369959 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.370212 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.370498 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.370587 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.370762 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.370853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.371024 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.371113 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.371289 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.371388 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.371548 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.371653 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.371822 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.372087 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.372356 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.372620 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.372886 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.373147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.398183 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.399959 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.400205 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.401435 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.403212 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.403429 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.405514 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.405790 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.406070 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.408737 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.409017 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.409298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.413616 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.414069 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.417189 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.417482 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.418799 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.419089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.427424 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.427424 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.427424 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.427424 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.427424 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.427424 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.427852 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.427852 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.427852 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.427852 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.427852 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.427852 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.428210 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.428210 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.439638 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.439912 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.443554 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.443831 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.444443 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.448206 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.448495 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.449114 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.452781 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.453072 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.453486 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.457181 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.458093 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.460837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.461215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.461496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.461737 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.462044 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.462352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.462506 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.466036 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.466350 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.466633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.466916 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.467185 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.467462 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.481561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.481818 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.482101 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.482386 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.487065 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.487348 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.487893 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.488167 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.490345 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.492126 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.492494 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.495570 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.495830 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.496134 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.496416 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.496825 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.496951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.498686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.498931 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.502071 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.502399 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.502682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.502963 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.503386 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.510876 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.511179 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.511447 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.511722 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.511996 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.512282 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.512563 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.517184 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.517482 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.517766 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.518039 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.518339 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.518618 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.518908 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.530659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.533922 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.537270 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.537694 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.538947 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.540537 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.541638 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.542322 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.542696 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.544991 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.547024 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.548633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.550270 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.550391 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.550552 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.551914 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.555187 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.555480 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.555763 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.556030 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.558417 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.560008 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.563263 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.563550 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.563840 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.564114 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.565145 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.565431 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.565706 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.573572 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87273) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.573890 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.574235 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.574411 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.574560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.574648 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.574712 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.574788 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.574955 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.575232 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.575452 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.575718 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.575995 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.576405 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.576697 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.576911 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.577223 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87273) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.582841 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87272) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:02:04.583127 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.583407 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.583680 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.583947 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.584216 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.584493 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.584762 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.585045 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.585876 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.586375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.586646 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.586926 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.587193 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87272) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:02:04.615519 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f5a740e9c0 pid: 87273 (default app) May 25 15:02:04.619487 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf016c9-b29c-4a0f-ba3e-0400d40e7196 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:04.619775 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf016c9-b29c-4a0f-ba3e-0400d40e7196 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:04.620049 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf016c9-b29c-4a0f-ba3e-0400d40e7196 None None] PATH_INFO: `/v3` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:04.624327 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Wed May 25 15:02:04 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:04.627014 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f5a740e9c0 pid: 87272 (default app) May 25 15:02:12.831561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6bf0a-2fc5-4c7a-8fd9-563ed9251b7e None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:12.832149 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6bf0a-2fc5-4c7a-8fd9-563ed9251b7e None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:12.832149 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6bf0a-2fc5-4c7a-8fd9-563ed9251b7e None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:12.833453 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 2/2] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:02:12.841696 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a598cea-585d-4a2c-8750-c5e57b0235d2 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:12.842214 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a598cea-585d-4a2c-8750-c5e57b0235d2 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:12.842214 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a598cea-585d-4a2c-8750-c5e57b0235d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:12.915174 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: INFO dbcounter [None req-5a598cea-585d-4a2c-8750-c5e57b0235d2 None None] Registered counter for database keystone May 25 15:02:12.937397 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG oslo_db.sqlalchemy.engines [None req-5a598cea-585d-4a2c-8750-c5e57b0235d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:02:12.944747 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writer thread running {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 15:02:13.244027 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG passlib.handlers.bcrypt [None req-5a598cea-585d-4a2c-8750-c5e57b0235d2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87272) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 15:02:13.244358 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG passlib.handlers.bcrypt [None req-5a598cea-585d-4a2c-8750-c5e57b0235d2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87272) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 15:02:13.303496 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-5a598cea-585d-4a2c-8750-c5e57b0235d2 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:13.305201 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-5a598cea-585d-4a2c-8750-c5e57b0235d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:13.451926 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 1/3] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 614 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 25 15:02:13.600867 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6bf0a-2fc5-4c7a-8fd9-563ed9251b7e None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:13.676737 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: INFO dbcounter [None req-17c6bf0a-2fc5-4c7a-8fd9-563ed9251b7e None None] Registered counter for database keystone May 25 15:02:13.697772 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG oslo_db.sqlalchemy.engines [None req-17c6bf0a-2fc5-4c7a-8fd9-563ed9251b7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:02:13.704271 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writer thread running {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 15:02:13.829338 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6bf0a-2fc5-4c7a-8fd9-563ed9251b7e None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:13.834170 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5466488-82cd-4ef3-bd2a-b8c46d06c7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:13.834878 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5466488-82cd-4ef3-bd2a-b8c46d06c7fa admin admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:13.835164 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5466488-82cd-4ef3-bd2a-b8c46d06c7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:13.835440 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5466488-82cd-4ef3-bd2a-b8c46d06c7fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:13.845602 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5466488-82cd-4ef3-bd2a-b8c46d06c7fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:14.008827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c5466488-82cd-4ef3-bd2a-b8c46d06c7fa admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 15:02:14.009693 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5466488-82cd-4ef3-bd2a-b8c46d06c7fa admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:14.021089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 3/4] 10.222.0.39 () {58 vars in 1324 bytes} [Wed May 25 15:02:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:02:14.027661 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a598cea-585d-4a2c-8750-c5e57b0235d2 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:14.043132 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a598cea-585d-4a2c-8750-c5e57b0235d2 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:14.049344 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb88077-05af-48b5-8e91-7fdb3a223af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:14.050556 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb88077-05af-48b5-8e91-7fdb3a223af4 admin admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:14.050837 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb88077-05af-48b5-8e91-7fdb3a223af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:14.051111 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb88077-05af-48b5-8e91-7fdb3a223af4 admin admin] PATH_INFO: `/v3/projects/91ba3df395e34a04b262fcb06d12fb3a` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:14.055226 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb88077-05af-48b5-8e91-7fdb3a223af4 admin admin] RBAC: Authorizing `identity:get_project(project_id=91ba3df395e34a04b262fcb06d12fb3a)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:14.106095 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2fb88077-05af-48b5-8e91-7fdb3a223af4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 15:02:14.106483 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb88077-05af-48b5-8e91-7fdb3a223af4 admin admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:14.111298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 2/5] 10.222.0.39 () {56 vars in 1207 bytes} [Wed May 25 15:02:14 2022] GET /identity/v3/projects/91ba3df395e34a04b262fcb06d12fb3a => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:16.380310 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb1bc1-fdb2-4dc0-bb53-c3e9ae2008d3 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:16.380890 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb1bc1-fdb2-4dc0-bb53-c3e9ae2008d3 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:16.380890 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb1bc1-fdb2-4dc0-bb53-c3e9ae2008d3 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:16.385339 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 4/6] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:16.391186 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71216efb-8f41-4786-9abb-52a3e8e8548d None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:16.391633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71216efb-8f41-4786-9abb-52a3e8e8548d None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:16.391818 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71216efb-8f41-4786-9abb-52a3e8e8548d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:16.412902 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-71216efb-8f41-4786-9abb-52a3e8e8548d None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:16.414501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-71216efb-8f41-4786-9abb-52a3e8e8548d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:16.424328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 3/7] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 25 15:02:16.447953 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb1bc1-fdb2-4dc0-bb53-c3e9ae2008d3 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:16.462050 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb1bc1-fdb2-4dc0-bb53-c3e9ae2008d3 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:16.467301 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c35ac-57f3-4ce2-a66c-9dfd2207784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:16.467959 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c35ac-57f3-4ce2-a66c-9dfd2207784c admin admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:16.468248 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c35ac-57f3-4ce2-a66c-9dfd2207784c admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:16.468529 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c35ac-57f3-4ce2-a66c-9dfd2207784c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:16.477165 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c35ac-57f3-4ce2-a66c-9dfd2207784c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:16.479100 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c35ac-57f3-4ce2-a66c-9dfd2207784c admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:16.488153 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 5/8] 10.222.0.39 () {58 vars in 1324 bytes} [Wed May 25 15:02:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:02:16.495366 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71216efb-8f41-4786-9abb-52a3e8e8548d None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:16.510941 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71216efb-8f41-4786-9abb-52a3e8e8548d None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:16.516817 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b47c1d-eb4d-4f4e-b405-cae724372e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:16.517718 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b47c1d-eb4d-4f4e-b405-cae724372e2a admin admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:16.518000 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b47c1d-eb4d-4f4e-b405-cae724372e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:16.518267 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b47c1d-eb4d-4f4e-b405-cae724372e2a admin admin] PATH_INFO: `/v3/users/6f740aaf3cae44509c45bafbff8e9374` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:16.519844 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b47c1d-eb4d-4f4e-b405-cae724372e2a admin admin] RBAC: Authorizing `identity:get_user(user_id=6f740aaf3cae44509c45bafbff8e9374)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:16.521686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b47c1d-eb4d-4f4e-b405-cae724372e2a admin admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:16.523307 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 4/9] 10.222.0.39 () {56 vars in 1198 bytes} [Wed May 25 15:02:16 2022] GET /identity/v3/users/6f740aaf3cae44509c45bafbff8e9374 => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:18.851806 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe2483-0509-4fc0-a800-2f94f4b681b0 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:18.852386 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe2483-0509-4fc0-a800-2f94f4b681b0 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:18.852386 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe2483-0509-4fc0-a800-2f94f4b681b0 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:18.853832 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 6/10] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:18.859370 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3c5d5-d610-4c46-9542-16763d5ee6ee None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:18.859868 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3c5d5-d610-4c46-9542-16763d5ee6ee None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:18.859955 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3c5d5-d610-4c46-9542-16763d5ee6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:18.877512 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-ecc3c5d5-d610-4c46-9542-16763d5ee6ee None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:18.878732 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-ecc3c5d5-d610-4c46-9542-16763d5ee6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:18.884213 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625180c5-57e2-43ad-973e-e3e1cf8aefb7 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:18.884499 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625180c5-57e2-43ad-973e-e3e1cf8aefb7 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:18.884773 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625180c5-57e2-43ad-973e-e3e1cf8aefb7 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:18.886112 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 7/11] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:18.891364 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87259fc-84e1-431e-a844-68e1c685313c None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:18.891686 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87259fc-84e1-431e-a844-68e1c685313c None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:18.891961 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87259fc-84e1-431e-a844-68e1c685313c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:18.933110 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG passlib.handlers.bcrypt [None req-f87259fc-84e1-431e-a844-68e1c685313c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87273) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 15:02:18.933542 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG passlib.handlers.bcrypt [None req-f87259fc-84e1-431e-a844-68e1c685313c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87273) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 15:02:18.968011 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 5/12] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:18.980491 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-f87259fc-84e1-431e-a844-68e1c685313c None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:18.982129 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-f87259fc-84e1-431e-a844-68e1c685313c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:18.993666 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3c5d5-d610-4c46-9542-16763d5ee6ee None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:19.018065 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:19.087483 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 8/13] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:19.105123 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3c5d5-d610-4c46-9542-16763d5ee6ee None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:19.110186 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87259fc-84e1-431e-a844-68e1c685313c None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:19.142899 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057bb34-038c-4a96-aaff-2b5da7023afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:19.143723 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057bb34-038c-4a96-aaff-2b5da7023afd None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:19.144011 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057bb34-038c-4a96-aaff-2b5da7023afd None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:19.144289 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057bb34-038c-4a96-aaff-2b5da7023afd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:19.157057 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057bb34-038c-4a96-aaff-2b5da7023afd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:19.168725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-e057bb34-038c-4a96-aaff-2b5da7023afd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:19.168725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:19.168725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:19.168725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:19.168725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:19.168725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:19.168725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:19.168725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:19.168725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:19.168725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:19.168725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:19.168725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:19.168725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:19.168725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:19.168725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:19.168725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:19.169633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:19.169633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:19.169633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:19.169633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:19.169633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:19.169633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:19.169633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:19.169633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:19.169633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:19.169633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:19.169633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:19.169633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:02:19.169633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:19.169633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:19.169633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:19.169633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:19.170511 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:19.170511 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:19.170511 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:19.170511 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:19.170511 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:19.170511 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:19.170511 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:19.170511 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:19.170511 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:19.170511 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:19.170511 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:19.170511 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:02:19.170511 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 6/14] 10.222.0.39 () {56 vars in 1096 bytes} [Wed May 25 15:02:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:02:19.176329 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057bb34-038c-4a96-aaff-2b5da7023afd None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:19.213429 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87259fc-84e1-431e-a844-68e1c685313c None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:19.215939 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:19.252542 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eefd1e-7d92-46cf-9a70-d0f6d976807f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:19.253478 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eefd1e-7d92-46cf-9a70-d0f6d976807f None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:19.253761 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eefd1e-7d92-46cf-9a70-d0f6d976807f None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:19.254031 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eefd1e-7d92-46cf-9a70-d0f6d976807f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:19.268341 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:19.288868 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057bb34-038c-4a96-aaff-2b5da7023afd None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:19.325542 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eefd1e-7d92-46cf-9a70-d0f6d976807f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:19.326222 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1a600-e40f-4cb7-a00f-82ca8ae9bf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:19.326935 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1a600-e40f-4cb7-a00f-82ca8ae9bf9e None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:19.327120 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eefd1e-7d92-46cf-9a70-d0f6d976807f None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:19.327222 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1a600-e40f-4cb7-a00f-82ca8ae9bf9e None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:19.327488 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1a600-e40f-4cb7-a00f-82ca8ae9bf9e None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:19.328242 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1a600-e40f-4cb7-a00f-82ca8ae9bf9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:19.328550 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1a600-e40f-4cb7-a00f-82ca8ae9bf9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:19.329951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1a600-e40f-4cb7-a00f-82ca8ae9bf9e None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:19.342203 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 7/15] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:02:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:19.347740 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1a600-e40f-4cb7-a00f-82ca8ae9bf9e None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:19.430223 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 9/16] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:02:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:02:19.436114 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eefd1e-7d92-46cf-9a70-d0f6d976807f None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:19.439151 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:19.453078 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1a600-e40f-4cb7-a00f-82ca8ae9bf9e None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:19.490747 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba7372-0fa5-402b-9cc4-b510b4eb15cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:19.491638 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba7372-0fa5-402b-9cc4-b510b4eb15cd None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:19.491921 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba7372-0fa5-402b-9cc4-b510b4eb15cd None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:19.492195 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba7372-0fa5-402b-9cc4-b510b4eb15cd None admin] PATH_INFO: `/v3/users/6f740aaf3cae44509c45bafbff8e9374` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:19.493424 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba7372-0fa5-402b-9cc4-b510b4eb15cd None admin] RBAC: Authorizing `identity:get_user(user_id=6f740aaf3cae44509c45bafbff8e9374)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:19.494963 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba7372-0fa5-402b-9cc4-b510b4eb15cd None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:19.496602 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 8/17] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:19 2022] GET /identity/v3/users/6f740aaf3cae44509c45bafbff8e9374 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:19.501975 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba7372-0fa5-402b-9cc4-b510b4eb15cd None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:19.516886 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:19.541368 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eefd1e-7d92-46cf-9a70-d0f6d976807f None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:19.576734 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7725af-87a1-43d9-82f1-de107a9d0332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:19.577540 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7725af-87a1-43d9-82f1-de107a9d0332 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:19.577826 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7725af-87a1-43d9-82f1-de107a9d0332 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:19.578103 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7725af-87a1-43d9-82f1-de107a9d0332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:19.599112 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7725af-87a1-43d9-82f1-de107a9d0332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:19.600609 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7725af-87a1-43d9-82f1-de107a9d0332 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:19.608404 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba7372-0fa5-402b-9cc4-b510b4eb15cd None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:19.622059 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-1e7725af-87a1-43d9-82f1-de107a9d0332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:02:19.622059 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:19.622059 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:19.622059 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:19.622059 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:19.622059 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:19.622059 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:19.622059 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:19.622059 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:19.622059 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:19.622059 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:19.622059 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:19.622059 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:02:19.622059 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:02:19.622059 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:02:19.622954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:02:19.622954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:19.622954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:19.622954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:19.622954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:19.622954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:19.622954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:19.622954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:19.622954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:02:19.622954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:19.622954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:19.622954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:19.622954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:19.622954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:19.622954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:19.622954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:19.622954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:19.623996 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:02:19.623996 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:02:19.623996 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:02:19.623996 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:02:19.623996 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 10/18] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:02:19.630965 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7725af-87a1-43d9-82f1-de107a9d0332 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:19.647603 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af0424-8442-4e40-9d37-008bfa836528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:19.648425 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af0424-8442-4e40-9d37-008bfa836528 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:19.648704 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af0424-8442-4e40-9d37-008bfa836528 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:19.648976 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af0424-8442-4e40-9d37-008bfa836528 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:19.650429 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af0424-8442-4e40-9d37-008bfa836528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:19.651909 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af0424-8442-4e40-9d37-008bfa836528 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:19.653751 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 9/19] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:02:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:19.659687 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af0424-8442-4e40-9d37-008bfa836528 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:19.689780 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:19.734531 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7725af-87a1-43d9-82f1-de107a9d0332 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:19.744751 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:19.764957 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af0424-8442-4e40-9d37-008bfa836528 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:19.770101 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6617f-8069-4bae-b4a7-7fdf5dbc7353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:19.770808 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6617f-8069-4bae-b4a7-7fdf5dbc7353 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:19.771097 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6617f-8069-4bae-b4a7-7fdf5dbc7353 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:19.771377 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6617f-8069-4bae-b4a7-7fdf5dbc7353 None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:19.772152 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6617f-8069-4bae-b4a7-7fdf5dbc7353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:19.772418 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6617f-8069-4bae-b4a7-7fdf5dbc7353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:19.773831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6617f-8069-4bae-b4a7-7fdf5dbc7353 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:19.791844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 11/20] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:19.801744 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1125c36-f173-44f3-8b53-5d9bb8690dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:19.802488 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1125c36-f173-44f3-8b53-5d9bb8690dc0 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:19.802780 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1125c36-f173-44f3-8b53-5d9bb8690dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:19.803061 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1125c36-f173-44f3-8b53-5d9bb8690dc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:19.803935 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1125c36-f173-44f3-8b53-5d9bb8690dc0 None admin] RBAC: Adding query filter params (role.id=ff521c95c8aa454ea3daa6bc36d055b1, scope.domain.id=default, user.id=6f740aaf3cae44509c45bafbff8e9374) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:19.804250 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1125c36-f173-44f3-8b53-5d9bb8690dc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:19.805766 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1125c36-f173-44f3-8b53-5d9bb8690dc0 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:19.813971 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 10/21] 10.222.0.39 () {56 vars in 1322 bytes} [Wed May 25 15:02:19 2022] GET /identity/v3/role_assignments?user.id=6f740aaf3cae44509c45bafbff8e9374&scope.domain.id=default&role.id=ff521c95c8aa454ea3daa6bc36d055b1 => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:22.395325 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fb47b-1e0f-48d0-b6b3-2721779cefc8 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:22.395889 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fb47b-1e0f-48d0-b6b3-2721779cefc8 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:22.395889 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fb47b-1e0f-48d0-b6b3-2721779cefc8 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:22.397333 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 12/22] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:22.403761 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc30eba-d844-4f7e-85ad-f12b14be5cb4 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:22.404692 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc30eba-d844-4f7e-85ad-f12b14be5cb4 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:22.405137 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc30eba-d844-4f7e-85ad-f12b14be5cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:22.435551 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-8fc30eba-d844-4f7e-85ad-f12b14be5cb4 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:22.437045 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-8fc30eba-d844-4f7e-85ad-f12b14be5cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:22.544676 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 11/23] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:22.580581 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085fb47b-1e0f-48d0-b6b3-2721779cefc8 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:22.618795 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3d4ea-8d3f-4bd5-898b-476125293988 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:22.619114 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3d4ea-8d3f-4bd5-898b-476125293988 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:22.619609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3d4ea-8d3f-4bd5-898b-476125293988 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:22.620801 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 12/24] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:02:22.626123 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bddace-00e5-43eb-ae50-9980944f924e None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:22.626442 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bddace-00e5-43eb-ae50-9980944f924e None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:22.626729 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bddace-00e5-43eb-ae50-9980944f924e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:22.655449 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-f1bddace-00e5-43eb-ae50-9980944f924e None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:22.656608 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-f1bddace-00e5-43eb-ae50-9980944f924e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:22.764070 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085fb47b-1e0f-48d0-b6b3-2721779cefc8 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:22.797130 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:22.826857 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54229b7-3552-4f09-8c5f-311cd414a3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:22.827685 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54229b7-3552-4f09-8c5f-311cd414a3ec None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:22.827970 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54229b7-3552-4f09-8c5f-311cd414a3ec None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:22.828248 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54229b7-3552-4f09-8c5f-311cd414a3ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:22.845587 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54229b7-3552-4f09-8c5f-311cd414a3ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:22.860002 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-d54229b7-3552-4f09-8c5f-311cd414a3ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:22.860002 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:22.860002 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:22.860002 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:22.860002 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:22.860002 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:22.860002 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:22.860002 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:22.860002 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:22.860002 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:22.860002 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:22.860002 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:22.860002 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:22.860002 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:22.860002 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:22.860002 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:22.860887 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:22.860887 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:22.860887 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:22.860887 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:22.860887 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:22.860887 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:22.860887 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:22.860887 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:22.860887 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:22.860887 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:22.860887 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:22.860887 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:02:22.860887 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:22.860887 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:22.860887 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:22.860887 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:22.861635 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:22.861635 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:22.861635 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:22.861635 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:22.861635 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:22.861635 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:22.861635 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:22.861635 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:22.861635 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:22.861635 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:22.861635 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:22.861635 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:02:22.861635 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 13/25] 10.222.0.39 () {56 vars in 1096 bytes} [Wed May 25 15:02:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:22.862924 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022a474-e19a-4cda-b5e0-07db5580b492 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:22.863374 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022a474-e19a-4cda-b5e0-07db5580b492 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:22.863990 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022a474-e19a-4cda-b5e0-07db5580b492 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:22.865400 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 14/26] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:22.868206 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 13/27] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:02:22.871256 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022a474-e19a-4cda-b5e0-07db5580b492 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:22.873298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7812576-d5d1-4c22-a96a-e158e6784e83 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:22.873814 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7812576-d5d1-4c22-a96a-e158e6784e83 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:22.874346 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7812576-d5d1-4c22-a96a-e158e6784e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:22.890621 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:22.904078 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-d7812576-d5d1-4c22-a96a-e158e6784e83 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:22.905907 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-d7812576-d5d1-4c22-a96a-e158e6784e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:23.055083 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022a474-e19a-4cda-b5e0-07db5580b492 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:23.059159 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 14/28] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:23.066713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7812576-d5d1-4c22-a96a-e158e6784e83 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:23.148879 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5868531-d9bf-43cd-aff3-5773be69af9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:23.149566 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5868531-d9bf-43cd-aff3-5773be69af9f None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:23.149849 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5868531-d9bf-43cd-aff3-5773be69af9f None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:23.150122 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5868531-d9bf-43cd-aff3-5773be69af9f None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:23.151005 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5868531-d9bf-43cd-aff3-5773be69af9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:23.151311 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5868531-d9bf-43cd-aff3-5773be69af9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:23.152724 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5868531-d9bf-43cd-aff3-5773be69af9f None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:23.174012 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 15/29] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:02:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:23.174837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5868531-d9bf-43cd-aff3-5773be69af9f None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:23.222634 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:23.288166 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7812576-d5d1-4c22-a96a-e158e6784e83 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:23.325969 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5868531-d9bf-43cd-aff3-5773be69af9f None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:23.339132 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a747e-37b6-4880-9b88-2f713892786b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:23.340172 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a747e-37b6-4880-9b88-2f713892786b None admin] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:23.340680 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a747e-37b6-4880-9b88-2f713892786b None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:23.341163 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a747e-37b6-4880-9b88-2f713892786b None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:23.342150 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a747e-37b6-4880-9b88-2f713892786b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:23.344269 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a747e-37b6-4880-9b88-2f713892786b None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:23.353882 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:23.411168 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34629d-b779-40fb-904b-736390818e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:23.412710 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34629d-b779-40fb-904b-736390818e7a None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:23.413192 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34629d-b779-40fb-904b-736390818e7a None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:23.413672 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34629d-b779-40fb-904b-736390818e7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:23.426476 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34629d-b779-40fb-904b-736390818e7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:23.428338 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34629d-b779-40fb-904b-736390818e7a None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:23.455024 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-5b34629d-b779-40fb-904b-736390818e7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:02:23.455024 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:23.455024 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:23.455024 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:23.455024 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:23.455024 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:23.455024 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:23.455024 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:23.455024 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:23.455024 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:23.455024 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:23.455024 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:23.455024 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:02:23.455024 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:02:23.455024 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:02:23.455810 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:02:23.455810 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:23.455810 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:23.455810 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:23.455810 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:23.455810 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:23.455810 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:23.455810 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:23.455810 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:02:23.455810 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:23.455810 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:23.455810 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:23.455810 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:23.455810 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:23.455810 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:23.455810 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:23.455810 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:23.456599 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:02:23.456599 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:02:23.456599 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:02:23.456599 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:02:23.456809 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 16/30] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:23.457727 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34629d-b779-40fb-904b-736390818e7a None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:23.506068 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 15/31] 10.222.0.39 () {60 vars in 1131 bytes} [Wed May 25 15:02:23 2022] POST /identity/v3/roles => generated 219 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:23.507640 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a747e-37b6-4880-9b88-2f713892786b None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:23.644826 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:23.667254 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34629d-b779-40fb-904b-736390818e7a None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:23.717758 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a747e-37b6-4880-9b88-2f713892786b None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:23.739124 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f530b-ff9d-47d2-9808-0fad4cddd183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:23.740376 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f530b-ff9d-47d2-9808-0fad4cddd183 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:23.740868 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f530b-ff9d-47d2-9808-0fad4cddd183 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:23.741359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f530b-ff9d-47d2-9808-0fad4cddd183 None admin] PATH_INFO: `/v3/users/6f740aaf3cae44509c45bafbff8e9374` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:23.743279 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f530b-ff9d-47d2-9808-0fad4cddd183 None admin] RBAC: Authorizing `identity:get_user(user_id=6f740aaf3cae44509c45bafbff8e9374)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:23.745429 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f530b-ff9d-47d2-9808-0fad4cddd183 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:23.747518 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 17/32] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:23 2022] GET /identity/v3/users/6f740aaf3cae44509c45bafbff8e9374 => generated 247 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:23.749214 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591a465-8851-4864-aa64-b11fa8ae6d2d None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:23.749702 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591a465-8851-4864-aa64-b11fa8ae6d2d None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:23.750196 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591a465-8851-4864-aa64-b11fa8ae6d2d None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:23.751810 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 18/33] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:23.753147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591a465-8851-4864-aa64-b11fa8ae6d2d None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:23.767478 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfddf9-6866-4a28-b450-22351cbee9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:23.768506 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfddf9-6866-4a28-b450-22351cbee9dc None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:23.768973 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfddf9-6866-4a28-b450-22351cbee9dc None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:23.769420 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfddf9-6866-4a28-b450-22351cbee9dc None admin] PATH_INFO: `/v3/domains` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:23.770390 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfddf9-6866-4a28-b450-22351cbee9dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:23.770885 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfddf9-6866-4a28-b450-22351cbee9dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:23.772626 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfddf9-6866-4a28-b450-22351cbee9dc None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:23.793238 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 16/34] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:23.795153 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d627b-f15d-4544-bdc4-12c9c80e1405 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:23.795616 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d627b-f15d-4544-bdc4-12c9c80e1405 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:23.796057 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d627b-f15d-4544-bdc4-12c9c80e1405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:23.814130 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-076d627b-f15d-4544-bdc4-12c9c80e1405 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:23.816028 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-076d627b-f15d-4544-bdc4-12c9c80e1405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:23.880115 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:23.888163 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591a465-8851-4864-aa64-b11fa8ae6d2d None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:23.906231 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 17/35] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:23.907143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d627b-f15d-4544-bdc4-12c9c80e1405 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:23.928309 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e3acf-5742-45ce-8dc7-aa497cda12f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:23.929501 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e3acf-5742-45ce-8dc7-aa497cda12f0 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:23.929987 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e3acf-5742-45ce-8dc7-aa497cda12f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:23.930512 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e3acf-5742-45ce-8dc7-aa497cda12f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:23.932127 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e3acf-5742-45ce-8dc7-aa497cda12f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:23.934731 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e3acf-5742-45ce-8dc7-aa497cda12f0 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:23.937178 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 19/36] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:02:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:23.939061 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70cc52-f5bb-4c0e-b9a3-db1d9cf9a41c None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:23.939967 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70cc52-f5bb-4c0e-b9a3-db1d9cf9a41c None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:23.940447 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70cc52-f5bb-4c0e-b9a3-db1d9cf9a41c None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:23.942466 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 20/37] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:23.943719 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70cc52-f5bb-4c0e-b9a3-db1d9cf9a41c None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:23.975743 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:24.034229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d627b-f15d-4544-bdc4-12c9c80e1405 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:24.053826 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70cc52-f5bb-4c0e-b9a3-db1d9cf9a41c None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:24.075936 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b38e1-efa3-4d96-b2c5-48a8e7e3f411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:24.077277 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b38e1-efa3-4d96-b2c5-48a8e7e3f411 None admin] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:24.077641 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b38e1-efa3-4d96-b2c5-48a8e7e3f411 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:24.078018 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b38e1-efa3-4d96-b2c5-48a8e7e3f411 None admin] PATH_INFO: `/v3/projects` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:24.078864 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b38e1-efa3-4d96-b2c5-48a8e7e3f411 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:24.080538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b38e1-efa3-4d96-b2c5-48a8e7e3f411 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:24.093118 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03eba43-8e09-4775-abcf-eb1c982929a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:24.093822 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03eba43-8e09-4775-abcf-eb1c982929a2 None admin] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:24.094106 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03eba43-8e09-4775-abcf-eb1c982929a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:24.094441 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03eba43-8e09-4775-abcf-eb1c982929a2 None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:24.095222 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03eba43-8e09-4775-abcf-eb1c982929a2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:24.096656 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03eba43-8e09-4775-abcf-eb1c982929a2 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:24.113576 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 18/38] 10.222.0.39 () {60 vars in 1141 bytes} [Wed May 25 15:02:23 2022] POST /identity/v3/projects => generated 301 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:24.114439 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b38e1-efa3-4d96-b2c5-48a8e7e3f411 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:24.167612 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:24.244841 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 21/39] 10.222.0.39 () {60 vars in 1131 bytes} [Wed May 25 15:02:23 2022] POST /identity/v3/roles => generated 225 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:24.247068 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d047b-c51c-42c7-8041-6cc375e4931c None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:24.247725 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d047b-c51c-42c7-8041-6cc375e4931c None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:24.248432 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d047b-c51c-42c7-8041-6cc375e4931c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:24.257899 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b38e1-efa3-4d96-b2c5-48a8e7e3f411 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:24.289079 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-6d5d047b-c51c-42c7-8041-6cc375e4931c None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:24.291816 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-6d5d047b-c51c-42c7-8041-6cc375e4931c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:24.319711 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bf217-6798-43ea-b306-e4016bbc6592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:24.320648 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bf217-6798-43ea-b306-e4016bbc6592 None admin] REQUEST_METHOD: `PUT` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:24.320943 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bf217-6798-43ea-b306-e4016bbc6592 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:24.321226 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bf217-6798-43ea-b306-e4016bbc6592 None admin] PATH_INFO: `/v3/domains/default/users/6f740aaf3cae44509c45bafbff8e9374/roles/ff521c95c8aa454ea3daa6bc36d055b1` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:24.324083 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bf217-6798-43ea-b306-e4016bbc6592 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6f740aaf3cae44509c45bafbff8e9374, role_id=ff521c95c8aa454ea3daa6bc36d055b1)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:24.325657 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bf217-6798-43ea-b306-e4016bbc6592 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:24.350543 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 19/40] 10.222.0.39 () {58 vars in 1361 bytes} [Wed May 25 15:02:24 2022] PUT /identity/v3/domains/default/users/6f740aaf3cae44509c45bafbff8e9374/roles/ff521c95c8aa454ea3daa6bc36d055b1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:02:24.351967 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8333658-f85d-4d01-8860-7974f017b3d8 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:24.352270 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8333658-f85d-4d01-8860-7974f017b3d8 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:24.352560 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8333658-f85d-4d01-8860-7974f017b3d8 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:24.359949 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 20/41] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:24.361519 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cd264-4f5a-45c2-96f9-812129b8cfd7 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:24.361859 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cd264-4f5a-45c2-96f9-812129b8cfd7 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:24.362152 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24cd264-4f5a-45c2-96f9-812129b8cfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:24.385004 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-b24cd264-4f5a-45c2-96f9-812129b8cfd7 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:24.386491 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-b24cd264-4f5a-45c2-96f9-812129b8cfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:24.393656 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 22/42] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:24.421014 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d047b-c51c-42c7-8041-6cc375e4931c None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:24.446745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:24.481642 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 21/43] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:24.510043 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cd264-4f5a-45c2-96f9-812129b8cfd7 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:24.557420 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:24.567995 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d047b-c51c-42c7-8041-6cc375e4931c None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:24.625763 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16662ee-4984-4c82-9dda-bbb1433c9fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:24.626501 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16662ee-4984-4c82-9dda-bbb1433c9fd5 None admin] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:24.626787 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16662ee-4984-4c82-9dda-bbb1433c9fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:24.627177 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16662ee-4984-4c82-9dda-bbb1433c9fd5 None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:24.627964 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16662ee-4984-4c82-9dda-bbb1433c9fd5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:24.629524 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16662ee-4984-4c82-9dda-bbb1433c9fd5 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:24.648746 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 23/44] 10.222.0.39 () {60 vars in 1131 bytes} [Wed May 25 15:02:24 2022] POST /identity/v3/roles => generated 223 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:02:24.664237 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24cd264-4f5a-45c2-96f9-812129b8cfd7 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:24.705215 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa356c-471c-4353-a157-59bb0b57a03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:24.706054 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa356c-471c-4353-a157-59bb0b57a03f None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:24.706376 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa356c-471c-4353-a157-59bb0b57a03f None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:24.706658 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa356c-471c-4353-a157-59bb0b57a03f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:24.707879 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa356c-471c-4353-a157-59bb0b57a03f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:24.709405 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa356c-471c-4353-a157-59bb0b57a03f None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:24.711367 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 22/45] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:02:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:24.717068 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16662ee-4984-4c82-9dda-bbb1433c9fd5 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:24.804925 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:24.833971 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16662ee-4984-4c82-9dda-bbb1433c9fd5 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:24.873744 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a668b-2928-4065-a63d-99dcf334dffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:24.874450 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a668b-2928-4065-a63d-99dcf334dffe None admin] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:24.874738 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a668b-2928-4065-a63d-99dcf334dffe None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:24.875001 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a668b-2928-4065-a63d-99dcf334dffe None admin] PATH_INFO: `/v3/projects` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:24.875732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a668b-2928-4065-a63d-99dcf334dffe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:24.877217 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a668b-2928-4065-a63d-99dcf334dffe None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:24.908183 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 24/46] 10.222.0.39 () {60 vars in 1141 bytes} [Wed May 25 15:02:24 2022] POST /identity/v3/projects => generated 312 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:26.751099 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc7317-9e26-4874-a724-3b4466f3bb28 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:26.751604 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc7317-9e26-4874-a724-3b4466f3bb28 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:26.751604 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc7317-9e26-4874-a724-3b4466f3bb28 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:26.753098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 23/47] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:26.758443 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00570e08-6e56-47d3-b30c-798c4a75a679 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:26.758867 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00570e08-6e56-47d3-b30c-798c4a75a679 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:26.759089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00570e08-6e56-47d3-b30c-798c4a75a679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:26.777140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-00570e08-6e56-47d3-b30c-798c4a75a679 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:26.778289 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-00570e08-6e56-47d3-b30c-798c4a75a679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:26.850212 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 25/48] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:02:26.876022 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc7317-9e26-4874-a724-3b4466f3bb28 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:26.980804 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:26.991328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc7317-9e26-4874-a724-3b4466f3bb28 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:27.030352 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d6895-b967-44f1-ac7e-b790525e6ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:27.031108 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d6895-b967-44f1-ac7e-b790525e6ae9 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:27.031397 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d6895-b967-44f1-ac7e-b790525e6ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:27.031678 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d6895-b967-44f1-ac7e-b790525e6ae9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:27.043007 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d6895-b967-44f1-ac7e-b790525e6ae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:27.051070 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-9d6d6895-b967-44f1-ac7e-b790525e6ae9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:27.051070 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:27.051070 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:27.051070 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:27.051070 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:27.051070 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:27.051070 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:27.051070 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:27.051070 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:27.051070 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:27.051070 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:27.051070 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:27.051070 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:27.051070 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:27.051070 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:27.051070 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:27.051913 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:27.051913 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:27.051913 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:27.051913 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:27.051913 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:27.051913 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:27.051913 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:27.051913 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:27.051913 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:27.051913 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:27.051913 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:27.051913 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:02:27.051913 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:27.051913 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:27.051913 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:27.051913 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:27.052682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:27.052682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:27.052682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:27.052682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:27.052682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:27.052682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:27.052682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:27.052682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:27.052682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:27.052682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:27.052682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:27.052682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:02:27.052682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 24/49] 10.222.0.39 () {56 vars in 1096 bytes} [Wed May 25 15:02:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:27.059829 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00570e08-6e56-47d3-b30c-798c4a75a679 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:27.124573 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:27.167864 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00570e08-6e56-47d3-b30c-798c4a75a679 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:27.168175 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805f34b-c319-4d99-a8ba-6245aa228e82 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:27.168472 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805f34b-c319-4d99-a8ba-6245aa228e82 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:27.168753 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805f34b-c319-4d99-a8ba-6245aa228e82 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:27.170135 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 25/50] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:02:27.175631 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae5c38-e43d-4046-a4b5-216432b214a5 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:27.175911 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae5c38-e43d-4046-a4b5-216432b214a5 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:27.176197 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae5c38-e43d-4046-a4b5-216432b214a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:27.193626 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-46ae5c38-e43d-4046-a4b5-216432b214a5 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:27.194860 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-46ae5c38-e43d-4046-a4b5-216432b214a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:27.202456 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a9738-cb50-4ed9-8cf1-7eb54b34a4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:27.203138 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a9738-cb50-4ed9-8cf1-7eb54b34a4e8 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:27.203420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a9738-cb50-4ed9-8cf1-7eb54b34a4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:27.203694 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a9738-cb50-4ed9-8cf1-7eb54b34a4e8 None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:27.204441 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a9738-cb50-4ed9-8cf1-7eb54b34a4e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:27.204750 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a9738-cb50-4ed9-8cf1-7eb54b34a4e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:27.206186 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a9738-cb50-4ed9-8cf1-7eb54b34a4e8 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:27.214830 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 26/51] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:02:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:27.220398 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a9738-cb50-4ed9-8cf1-7eb54b34a4e8 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:27.267941 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 26/52] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:02:27.293310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae5c38-e43d-4046-a4b5-216432b214a5 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:27.320504 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a9738-cb50-4ed9-8cf1-7eb54b34a4e8 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:27.342504 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:27.357591 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee51b33-be77-49a4-a363-4c2853ebbe21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:27.358573 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee51b33-be77-49a4-a363-4c2853ebbe21 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:27.358864 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee51b33-be77-49a4-a363-4c2853ebbe21 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:27.359145 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee51b33-be77-49a4-a363-4c2853ebbe21 None admin] PATH_INFO: `/v3/users/6f740aaf3cae44509c45bafbff8e9374` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:27.360390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee51b33-be77-49a4-a363-4c2853ebbe21 None admin] RBAC: Authorizing `identity:get_user(user_id=6f740aaf3cae44509c45bafbff8e9374)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:27.361860 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee51b33-be77-49a4-a363-4c2853ebbe21 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:27.363543 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 27/53] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:27 2022] GET /identity/v3/users/6f740aaf3cae44509c45bafbff8e9374 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:27.369052 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee51b33-be77-49a4-a363-4c2853ebbe21 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:27.375537 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:27.391408 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae5c38-e43d-4046-a4b5-216432b214a5 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:27.426063 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6302257-18c5-41c9-9b62-6cae47fb7f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:27.427315 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6302257-18c5-41c9-9b62-6cae47fb7f77 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:27.427608 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6302257-18c5-41c9-9b62-6cae47fb7f77 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:27.427885 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6302257-18c5-41c9-9b62-6cae47fb7f77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:27.429180 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6302257-18c5-41c9-9b62-6cae47fb7f77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:27.430767 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6302257-18c5-41c9-9b62-6cae47fb7f77 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:27.433391 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 27/54] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:02:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:27.438585 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6302257-18c5-41c9-9b62-6cae47fb7f77 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:27.480001 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee51b33-be77-49a4-a363-4c2853ebbe21 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:27.515059 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffefab-34f5-4f68-ba1d-cf6aa928e3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:27.515868 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffefab-34f5-4f68-ba1d-cf6aa928e3ac None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:27.516153 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffefab-34f5-4f68-ba1d-cf6aa928e3ac None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:27.516434 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffefab-34f5-4f68-ba1d-cf6aa928e3ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:27.517639 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffefab-34f5-4f68-ba1d-cf6aa928e3ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:27.519125 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffefab-34f5-4f68-ba1d-cf6aa928e3ac None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:27.520763 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 28/55] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:02:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:27.526515 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffefab-34f5-4f68-ba1d-cf6aa928e3ac None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:27.546948 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6302257-18c5-41c9-9b62-6cae47fb7f77 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:27.582248 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d998e3-6055-41f0-aa20-e6002179e8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:27.582841 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:27.582969 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d998e3-6055-41f0-aa20-e6002179e8b5 None admin] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:27.583197 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d998e3-6055-41f0-aa20-e6002179e8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:27.583478 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d998e3-6055-41f0-aa20-e6002179e8b5 None admin] PATH_INFO: `/v3/projects` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:27.584200 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d998e3-6055-41f0-aa20-e6002179e8b5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:27.585642 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d998e3-6055-41f0-aa20-e6002179e8b5 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:27.610819 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 28/56] 10.222.0.39 () {60 vars in 1140 bytes} [Wed May 25 15:02:27 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:27.630093 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffefab-34f5-4f68-ba1d-cf6aa928e3ac None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:27.672769 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21c050-d1ed-4ea8-9da1-2e9cb7c42f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:27.673482 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21c050-d1ed-4ea8-9da1-2e9cb7c42f55 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:27.673768 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21c050-d1ed-4ea8-9da1-2e9cb7c42f55 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:27.674049 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21c050-d1ed-4ea8-9da1-2e9cb7c42f55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:27.675303 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21c050-d1ed-4ea8-9da1-2e9cb7c42f55 None admin] RBAC: Adding query filter params (role.id=ff521c95c8aa454ea3daa6bc36d055b1, scope.domain.id=default, user.id=6f740aaf3cae44509c45bafbff8e9374) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:27.675607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21c050-d1ed-4ea8-9da1-2e9cb7c42f55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:27.677103 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21c050-d1ed-4ea8-9da1-2e9cb7c42f55 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:27.688033 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 29/57] 10.222.0.39 () {56 vars in 1322 bytes} [Wed May 25 15:02:27 2022] GET /identity/v3/role_assignments?user.id=6f740aaf3cae44509c45bafbff8e9374&scope.domain.id=default&role.id=ff521c95c8aa454ea3daa6bc36d055b1 => generated 530 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:29.975383 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8e681-69b2-4c6b-bd7b-e5194fa8fd3e None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:29.975928 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8e681-69b2-4c6b-bd7b-e5194fa8fd3e None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:29.975928 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8e681-69b2-4c6b-bd7b-e5194fa8fd3e None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:29.977349 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 29/58] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:29.984010 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a63cd3-2cfa-4c0a-9603-b20f1f3655ec None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:29.984661 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a63cd3-2cfa-4c0a-9603-b20f1f3655ec None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:29.984947 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a63cd3-2cfa-4c0a-9603-b20f1f3655ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:30.013123 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-f0a63cd3-2cfa-4c0a-9603-b20f1f3655ec None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:30.014375 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-f0a63cd3-2cfa-4c0a-9603-b20f1f3655ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:30.091427 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 30/59] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:30.117921 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8e681-69b2-4c6b-bd7b-e5194fa8fd3e None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:30.122673 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:30.234680 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8e681-69b2-4c6b-bd7b-e5194fa8fd3e None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:30.270519 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcb7f7-8438-4c8d-bf68-2c1036b802f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:30.271322 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcb7f7-8438-4c8d-bf68-2c1036b802f8 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:30.271609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcb7f7-8438-4c8d-bf68-2c1036b802f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:30.271883 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcb7f7-8438-4c8d-bf68-2c1036b802f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:30.273124 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcb7f7-8438-4c8d-bf68-2c1036b802f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:30.274626 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcb7f7-8438-4c8d-bf68-2c1036b802f8 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:30.276258 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 30/60] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:02:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:30.282137 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a63cd3-2cfa-4c0a-9603-b20f1f3655ec None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:30.332974 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:30.385327 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a63cd3-2cfa-4c0a-9603-b20f1f3655ec None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:30.421513 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f358ca6-48bc-47ec-a806-449d5ceeb8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:30.422277 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f358ca6-48bc-47ec-a806-449d5ceeb8ef None admin] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:30.422621 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f358ca6-48bc-47ec-a806-449d5ceeb8ef None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:30.422952 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f358ca6-48bc-47ec-a806-449d5ceeb8ef None admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:30.423724 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f358ca6-48bc-47ec-a806-449d5ceeb8ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:30.425587 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f358ca6-48bc-47ec-a806-449d5ceeb8ef None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:30.455942 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 31/61] 10.222.0.39 () {60 vars in 1132 bytes} [Wed May 25 15:02:30 2022] POST /identity/v3/users => generated 275 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:33.846547 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad990b-c592-4700-8ac1-ff2871c1e0c7 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:33.847272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad990b-c592-4700-8ac1-ff2871c1e0c7 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:33.847272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad990b-c592-4700-8ac1-ff2871c1e0c7 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:33.848752 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 31/62] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:33.854426 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0d552-2714-4d53-9a95-ca378cce510c None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:33.854870 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0d552-2714-4d53-9a95-ca378cce510c None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:33.855086 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0d552-2714-4d53-9a95-ca378cce510c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:33.878433 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-a4b0d552-2714-4d53-9a95-ca378cce510c None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:33.879650 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-a4b0d552-2714-4d53-9a95-ca378cce510c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:33.968602 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 32/63] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:02:34.006049 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad990b-c592-4700-8ac1-ff2871c1e0c7 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:34.078887 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187da6d-0fd9-4764-996a-5b940caa6e7c None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:34.079955 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187da6d-0fd9-4764-996a-5b940caa6e7c None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:34.080432 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187da6d-0fd9-4764-996a-5b940caa6e7c None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:34.082115 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 33/64] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:34.087489 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f53b64-9170-4c16-9131-a3efc580a54f None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:34.088259 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f53b64-9170-4c16-9131-a3efc580a54f None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:34.088743 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f53b64-9170-4c16-9131-a3efc580a54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:34.118785 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:34.127646 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-55f53b64-9170-4c16-9131-a3efc580a54f None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:34.128927 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-55f53b64-9170-4c16-9131-a3efc580a54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:34.181817 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:34.202865 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad990b-c592-4700-8ac1-ff2871c1e0c7 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:34.241166 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 34/65] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:02:34.278800 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f53b64-9170-4c16-9131-a3efc580a54f None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:34.284514 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de67b7-75a1-4905-a2a9-ccaf0c63ab5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:34.285357 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de67b7-75a1-4905-a2a9-ccaf0c63ab5d None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:34.285652 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de67b7-75a1-4905-a2a9-ccaf0c63ab5d None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:34.285935 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de67b7-75a1-4905-a2a9-ccaf0c63ab5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:34.307778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de67b7-75a1-4905-a2a9-ccaf0c63ab5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:34.316501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-08de67b7-75a1-4905-a2a9-ccaf0c63ab5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:34.316501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:34.316501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:34.316501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:34.316501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:34.316501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:34.316501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:34.316501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:34.316501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:34.316501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:34.316501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:34.316501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:34.316501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:34.316501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:34.316501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:34.316501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:34.317538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:34.317538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:34.317538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:34.317538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:34.317538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:34.317538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:34.317538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:34.317538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:34.317538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:34.317538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:34.317538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:34.317538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:02:34.317538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:34.317538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:34.317538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:34.317538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:34.318611 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:34.318611 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:34.318611 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:34.318611 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:34.318611 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:34.318611 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:34.318611 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:34.318611 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:34.318611 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:34.318611 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:34.318611 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:34.318611 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:02:34.318611 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 32/66] 10.222.0.39 () {56 vars in 1096 bytes} [Wed May 25 15:02:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:34.323425 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de67b7-75a1-4905-a2a9-ccaf0c63ab5d None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:34.394547 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f53b64-9170-4c16-9131-a3efc580a54f None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:34.434542 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c45b3f-2568-45aa-9b6b-3503416e9439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:34.435947 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c45b3f-2568-45aa-9b6b-3503416e9439 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:34.436612 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c45b3f-2568-45aa-9b6b-3503416e9439 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:34.437138 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c45b3f-2568-45aa-9b6b-3503416e9439 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:34.439295 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de67b7-75a1-4905-a2a9-ccaf0c63ab5d None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:34.454840 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c45b3f-2568-45aa-9b6b-3503416e9439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:34.463200 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-23c45b3f-2568-45aa-9b6b-3503416e9439 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:02:34.463200 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:34.463200 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:34.463200 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:34.463200 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:34.463200 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:34.463200 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:34.463200 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:34.463200 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:34.463200 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:34.463200 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:34.463200 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:34.463200 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:34.463200 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:34.463200 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:34.463200 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:34.464042 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:34.464042 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:34.464042 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:34.464042 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:34.464042 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:34.464042 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:34.464042 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:34.464042 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:34.464042 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:34.464042 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:34.464042 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:34.464042 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:02:34.464042 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:34.464042 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:34.464042 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:34.464042 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:34.464838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:34.464838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:34.464838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:34.464838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:34.464838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:34.464838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:34.464838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:34.464838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:34.464838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:34.464838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:34.464838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:02:34.464838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:02:34.464838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 35/67] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:02:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:34.466153 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa10dc7-597d-4a08-9fa9-e71352ced5fa None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:34.466670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa10dc7-597d-4a08-9fa9-e71352ced5fa None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:34.466670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa10dc7-597d-4a08-9fa9-e71352ced5fa None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:34.468304 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 36/68] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:34.469619 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedeec9-ad03-400f-8ac9-2d80ce5fc5ee None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:34.469945 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedeec9-ad03-400f-8ac9-2d80ce5fc5ee None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:34.470309 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedeec9-ad03-400f-8ac9-2d80ce5fc5ee None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:34.471887 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 37/69] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:34.472925 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedeec9-ad03-400f-8ac9-2d80ce5fc5ee None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:34.491272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:34.498591 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347769c6-1f58-4bd9-a5a0-869cca08d8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:34.499301 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347769c6-1f58-4bd9-a5a0-869cca08d8db None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:34.499592 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347769c6-1f58-4bd9-a5a0-869cca08d8db None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:34.499878 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347769c6-1f58-4bd9-a5a0-869cca08d8db None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:34.500659 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347769c6-1f58-4bd9-a5a0-869cca08d8db None admin] RBAC: Adding query filter params (name=admin) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:34.500974 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347769c6-1f58-4bd9-a5a0-869cca08d8db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:34.502447 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347769c6-1f58-4bd9-a5a0-869cca08d8db None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:34.507107 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:34.512079 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 33/70] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:02:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:34.514057 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0cbce-9fd1-4c2d-9219-a3cf1ecf503e None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:34.514626 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0cbce-9fd1-4c2d-9219-a3cf1ecf503e None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:34.515202 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0cbce-9fd1-4c2d-9219-a3cf1ecf503e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:34.532621 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-bdb0cbce-9fd1-4c2d-9219-a3cf1ecf503e None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:34.533889 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-bdb0cbce-9fd1-4c2d-9219-a3cf1ecf503e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:34.610994 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedeec9-ad03-400f-8ac9-2d80ce5fc5ee None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:34.630262 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 34/71] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:34.630262 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b6d6a-189c-4a21-9ea3-1f12e66d418e None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:34.630262 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b6d6a-189c-4a21-9ea3-1f12e66d418e None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:34.630262 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b6d6a-189c-4a21-9ea3-1f12e66d418e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:34.646227 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-5d1b6d6a-189c-4a21-9ea3-1f12e66d418e None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:34.647397 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-5d1b6d6a-189c-4a21-9ea3-1f12e66d418e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:34.660849 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8db73-c71c-49ae-b97e-23959ca2248f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:34.661656 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8db73-c71c-49ae-b97e-23959ca2248f None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:34.662005 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8db73-c71c-49ae-b97e-23959ca2248f None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:34.662380 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8db73-c71c-49ae-b97e-23959ca2248f None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:34.663282 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8db73-c71c-49ae-b97e-23959ca2248f None admin] RBAC: Adding query filter params (name=member) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:34.663664 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8db73-c71c-49ae-b97e-23959ca2248f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:34.665075 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8db73-c71c-49ae-b97e-23959ca2248f None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:34.679144 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 38/72] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:02:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:34.679144 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8db73-c71c-49ae-b97e-23959ca2248f None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:34.723407 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 35/73] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:34.724303 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b6d6a-189c-4a21-9ea3-1f12e66d418e None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:34.775129 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:34.779291 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:34.788865 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8db73-c71c-49ae-b97e-23959ca2248f None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:34.823265 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684d869-0b41-453e-8b54-ee52dd4e48c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:34.823647 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b6d6a-189c-4a21-9ea3-1f12e66d418e None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:34.824176 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684d869-0b41-453e-8b54-ee52dd4e48c3 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:34.824472 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684d869-0b41-453e-8b54-ee52dd4e48c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:34.824745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684d869-0b41-453e-8b54-ee52dd4e48c3 None admin] PATH_INFO: `/v3/users/6f740aaf3cae44509c45bafbff8e9374` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:34.825990 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684d869-0b41-453e-8b54-ee52dd4e48c3 None admin] RBAC: Authorizing `identity:get_user(user_id=6f740aaf3cae44509c45bafbff8e9374)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:34.827498 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684d869-0b41-453e-8b54-ee52dd4e48c3 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:34.829141 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 39/74] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:34 2022] GET /identity/v3/users/6f740aaf3cae44509c45bafbff8e9374 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:34.829914 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684d869-0b41-453e-8b54-ee52dd4e48c3 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:34.863746 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a707c1-ef4a-42d2-8f92-d1be5ac1d15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:34.864623 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a707c1-ef4a-42d2-8f92-d1be5ac1d15d None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:34.864912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a707c1-ef4a-42d2-8f92-d1be5ac1d15d None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:34.865191 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a707c1-ef4a-42d2-8f92-d1be5ac1d15d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:34.878076 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a707c1-ef4a-42d2-8f92-d1be5ac1d15d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:34.886606 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-e3a707c1-ef4a-42d2-8f92-d1be5ac1d15d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:02:34.886606 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:34.886606 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:34.886606 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:34.886606 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:34.886606 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:34.886606 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:34.886606 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:34.886606 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:34.886606 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:34.886606 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:34.886606 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:34.886606 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:34.886606 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:34.886606 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:34.886606 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:34.887585 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:34.887585 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:34.887585 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:34.887585 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:34.887585 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:34.887585 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:34.887585 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:34.887585 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:34.887585 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:34.887585 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:34.887585 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:34.887585 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:02:34.887585 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:34.887585 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:34.887585 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:34.887585 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:34.888328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:34.888328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:34.888328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:34.888328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:34.888328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:34.888328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:34.888328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:34.888328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:34.888328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:34.888328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:34.888328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:02:34.888328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:02:34.888328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 36/75] 10.222.0.39 () {56 vars in 1114 bytes} [Wed May 25 15:02:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:34.890443 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399bf38-67f8-4bca-8e9f-9085e20a8783 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:34.890745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399bf38-67f8-4bca-8e9f-9085e20a8783 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:34.891120 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399bf38-67f8-4bca-8e9f-9085e20a8783 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:34.892343 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 37/76] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:34.893389 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399bf38-67f8-4bca-8e9f-9085e20a8783 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:34.935799 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684d869-0b41-453e-8b54-ee52dd4e48c3 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:34.970205 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e63bb-389e-4161-83e8-0eb984741aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:34.971103 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e63bb-389e-4161-83e8-0eb984741aed None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:34.971370 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e63bb-389e-4161-83e8-0eb984741aed None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:34.971642 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e63bb-389e-4161-83e8-0eb984741aed None admin] PATH_INFO: `/v3/users/59ac1efaf68a45108260a4d69c510080` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:34.987649 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e63bb-389e-4161-83e8-0eb984741aed None admin] RBAC: Authorizing `identity:get_user(user_id=59ac1efaf68a45108260a4d69c510080)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:34.989134 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e63bb-389e-4161-83e8-0eb984741aed None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:34.990905 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 40/77] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:34 2022] GET /identity/v3/users/59ac1efaf68a45108260a4d69c510080 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:34.995762 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e63bb-389e-4161-83e8-0eb984741aed None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:34.997315 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399bf38-67f8-4bca-8e9f-9085e20a8783 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:35.007936 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:35.012631 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:35.033467 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46ad31-1195-405f-adeb-c0ba92382e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:35.034288 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46ad31-1195-405f-adeb-c0ba92382e24 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:35.034609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46ad31-1195-405f-adeb-c0ba92382e24 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:35.034890 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46ad31-1195-405f-adeb-c0ba92382e24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:35.045459 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46ad31-1195-405f-adeb-c0ba92382e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:35.053656 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-ff46ad31-1195-405f-adeb-c0ba92382e24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:02:35.053656 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:35.053656 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:35.053656 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:35.053656 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:35.053656 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:35.053656 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:35.053656 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:35.053656 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:35.053656 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:35.053656 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:35.053656 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:35.053656 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:35.053656 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:35.053656 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:35.053656 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:35.054579 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:35.054579 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:35.054579 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:35.054579 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:35.054579 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:35.054579 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:35.054579 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:35.054579 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:35.054579 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:35.054579 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:35.054579 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:35.054579 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:02:35.054579 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:35.054579 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:35.054579 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:35.054579 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:35.055516 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:35.055516 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:35.055516 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:35.055516 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:35.055516 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:35.055516 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:35.055516 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:35.055516 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:35.055516 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:35.055516 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:35.055516 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:02:35.055516 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:02:35.055516 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 38/78] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:02:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:35.056344 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46ad31-1195-405f-adeb-c0ba92382e24 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:35.106899 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e63bb-389e-4161-83e8-0eb984741aed None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:35.141700 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbd4bc-fa33-40b1-8b37-20ad3123259b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:35.142388 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbd4bc-fa33-40b1-8b37-20ad3123259b None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:35.142676 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbd4bc-fa33-40b1-8b37-20ad3123259b None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:35.142954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbd4bc-fa33-40b1-8b37-20ad3123259b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:35.158633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46ad31-1195-405f-adeb-c0ba92382e24 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:35.196577 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c184b9-ea26-4319-a79f-67f1da232790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:35.197153 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c184b9-ea26-4319-a79f-67f1da232790 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:35.197488 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c184b9-ea26-4319-a79f-67f1da232790 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:35.197720 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c184b9-ea26-4319-a79f-67f1da232790 None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:35.198502 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c184b9-ea26-4319-a79f-67f1da232790 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:35.198813 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c184b9-ea26-4319-a79f-67f1da232790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:35.200271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c184b9-ea26-4319-a79f-67f1da232790 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:35.208377 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 39/79] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:02:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:35.209586 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2a930-e178-42a8-a2af-569bda935dde None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:35.209889 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2a930-e178-42a8-a2af-569bda935dde None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:35.210172 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2a930-e178-42a8-a2af-569bda935dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:35.217632 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbd4bc-fa33-40b1-8b37-20ad3123259b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:35.219162 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbd4bc-fa33-40b1-8b37-20ad3123259b None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:35.226626 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-83e2a930-e178-42a8-a2af-569bda935dde None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:35.227880 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-83e2a930-e178-42a8-a2af-569bda935dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:35.234089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:35.256529 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:35.294073 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 40/80] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:35.295031 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2a930-e178-42a8-a2af-569bda935dde None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:35.325091 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 41/81] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:02:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:02:35.325942 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbd4bc-fa33-40b1-8b37-20ad3123259b None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:35.393907 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2a930-e178-42a8-a2af-569bda935dde None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:35.422253 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbd4bc-fa33-40b1-8b37-20ad3123259b None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:35.429784 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153c77f-cdf7-454e-9ba3-1f3497f74faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:35.430482 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153c77f-cdf7-454e-9ba3-1f3497f74faf None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:35.430776 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153c77f-cdf7-454e-9ba3-1f3497f74faf None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:35.431061 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153c77f-cdf7-454e-9ba3-1f3497f74faf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:35.437014 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:35.460536 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952d45f-c6f8-4460-955a-68f39aed8639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:35.461222 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952d45f-c6f8-4460-955a-68f39aed8639 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:35.461513 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952d45f-c6f8-4460-955a-68f39aed8639 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:35.461804 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952d45f-c6f8-4460-955a-68f39aed8639 None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:35.462593 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952d45f-c6f8-4460-955a-68f39aed8639 None admin] RBAC: Adding query filter params (name=member) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:35.462907 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952d45f-c6f8-4460-955a-68f39aed8639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:35.464351 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952d45f-c6f8-4460-955a-68f39aed8639 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:35.467287 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:35.473160 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 42/82] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:02:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:35.473995 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952d45f-c6f8-4460-955a-68f39aed8639 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:35.507360 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153c77f-cdf7-454e-9ba3-1f3497f74faf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:35.508882 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153c77f-cdf7-454e-9ba3-1f3497f74faf None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:35.574847 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952d45f-c6f8-4460-955a-68f39aed8639 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:35.607563 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 41/83] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:02:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:02:35.608555 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153c77f-cdf7-454e-9ba3-1f3497f74faf None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:35.610964 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803f926-3de6-4553-be2d-071eeb8a4a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:35.611860 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803f926-3de6-4553-be2d-071eeb8a4a7e None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:35.612581 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803f926-3de6-4553-be2d-071eeb8a4a7e None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:35.612869 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803f926-3de6-4553-be2d-071eeb8a4a7e None admin] PATH_INFO: `/v3/users/59ac1efaf68a45108260a4d69c510080` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:35.615060 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803f926-3de6-4553-be2d-071eeb8a4a7e None admin] RBAC: Authorizing `identity:get_user(user_id=59ac1efaf68a45108260a4d69c510080)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:35.616525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803f926-3de6-4553-be2d-071eeb8a4a7e None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:35.618568 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 43/84] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:35 2022] GET /identity/v3/users/59ac1efaf68a45108260a4d69c510080 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:35.619339 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803f926-3de6-4553-be2d-071eeb8a4a7e None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:35.669204 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:35.676785 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:35.711861 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153c77f-cdf7-454e-9ba3-1f3497f74faf None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:35.724531 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803f926-3de6-4553-be2d-071eeb8a4a7e None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:35.745641 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904e5a4-8525-4800-b076-66c8e4e13cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:35.746738 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904e5a4-8525-4800-b076-66c8e4e13cec None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:35.747046 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904e5a4-8525-4800-b076-66c8e4e13cec None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:35.747325 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904e5a4-8525-4800-b076-66c8e4e13cec None admin] PATH_INFO: `/v3/domains/default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:35.748496 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904e5a4-8525-4800-b076-66c8e4e13cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:35.749949 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904e5a4-8525-4800-b076-66c8e4e13cec None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:35.756112 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 42/85] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:02:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:35.756112 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904e5a4-8525-4800-b076-66c8e4e13cec None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:35.759330 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6ed9e-3306-4ad3-b095-5944c776347a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:35.760203 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6ed9e-3306-4ad3-b095-5944c776347a None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:35.760495 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6ed9e-3306-4ad3-b095-5944c776347a None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:35.760773 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6ed9e-3306-4ad3-b095-5944c776347a None admin] PATH_INFO: `/v3/projects/d8426986884141db8d183e5b9a859a3b` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:35.762120 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6ed9e-3306-4ad3-b095-5944c776347a None admin] RBAC: Authorizing `identity:get_project(project_id=d8426986884141db8d183e5b9a859a3b)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:35.763614 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6ed9e-3306-4ad3-b095-5944c776347a None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:35.765341 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 44/86] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:02:35 2022] GET /identity/v3/projects/d8426986884141db8d183e5b9a859a3b => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:35.770303 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6ed9e-3306-4ad3-b095-5944c776347a None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:35.856488 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904e5a4-8525-4800-b076-66c8e4e13cec None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:35.865410 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6ed9e-3306-4ad3-b095-5944c776347a None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:35.878453 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:35.890142 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c8b95-3cc8-4562-a843-f65c9f0dffe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:35.891066 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c8b95-3cc8-4562-a843-f65c9f0dffe2 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:35.891358 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c8b95-3cc8-4562-a843-f65c9f0dffe2 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:35.891645 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c8b95-3cc8-4562-a843-f65c9f0dffe2 None admin] PATH_INFO: `/v3/users/59ac1efaf68a45108260a4d69c510080` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:35.892866 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c8b95-3cc8-4562-a843-f65c9f0dffe2 None admin] RBAC: Authorizing `identity:get_user(user_id=59ac1efaf68a45108260a4d69c510080)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:35.894365 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c8b95-3cc8-4562-a843-f65c9f0dffe2 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:35.896019 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 43/87] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:35 2022] GET /identity/v3/users/59ac1efaf68a45108260a4d69c510080 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:35.896787 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c8b95-3cc8-4562-a843-f65c9f0dffe2 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:35.899398 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:35.899495 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ecb5a-59a9-458e-a056-81c1562dfaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:35.900369 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ecb5a-59a9-458e-a056-81c1562dfaf7 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:35.900659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ecb5a-59a9-458e-a056-81c1562dfaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:35.900944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ecb5a-59a9-458e-a056-81c1562dfaf7 None admin] PATH_INFO: `/v3/projects/d8426986884141db8d183e5b9a859a3b` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:35.902151 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ecb5a-59a9-458e-a056-81c1562dfaf7 None admin] RBAC: Authorizing `identity:get_project(project_id=d8426986884141db8d183e5b9a859a3b)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:35.903784 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ecb5a-59a9-458e-a056-81c1562dfaf7 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:35.905506 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 45/88] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:02:35 2022] GET /identity/v3/projects/d8426986884141db8d183e5b9a859a3b => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:35.906281 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ecb5a-59a9-458e-a056-81c1562dfaf7 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:36.005041 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c8b95-3cc8-4562-a843-f65c9f0dffe2 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:36.007826 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ecb5a-59a9-458e-a056-81c1562dfaf7 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:36.040650 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da75d21-f415-4d7e-8321-bdb3b1a15443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:36.041373 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da75d21-f415-4d7e-8321-bdb3b1a15443 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:36.041662 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da75d21-f415-4d7e-8321-bdb3b1a15443 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:36.041923 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da75d21-f415-4d7e-8321-bdb3b1a15443 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:36.043425 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e16e19-03b4-4fae-812c-dc4e501e8211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:36.044095 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e16e19-03b4-4fae-812c-dc4e501e8211 None admin] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:36.044377 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e16e19-03b4-4fae-812c-dc4e501e8211 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:36.044670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e16e19-03b4-4fae-812c-dc4e501e8211 None admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:36.045374 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e16e19-03b4-4fae-812c-dc4e501e8211 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:36.046881 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e16e19-03b4-4fae-812c-dc4e501e8211 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:36.067018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 46/89] 10.222.0.39 () {60 vars in 1132 bytes} [Wed May 25 15:02:35 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:36.067864 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e16e19-03b4-4fae-812c-dc4e501e8211 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:36.115806 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da75d21-f415-4d7e-8321-bdb3b1a15443 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:36.117299 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da75d21-f415-4d7e-8321-bdb3b1a15443 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:36.117463 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:36.119549 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:36.198392 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e16e19-03b4-4fae-812c-dc4e501e8211 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:36.230325 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 44/90] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:02:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:02:36.231906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da75d21-f415-4d7e-8321-bdb3b1a15443 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:36.242765 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848c50c-135b-40e5-8562-1b7a68141a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:36.243834 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848c50c-135b-40e5-8562-1b7a68141a6c None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:36.244126 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848c50c-135b-40e5-8562-1b7a68141a6c None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:36.244408 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848c50c-135b-40e5-8562-1b7a68141a6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:36.245595 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848c50c-135b-40e5-8562-1b7a68141a6c None admin] RBAC: Adding query filter params (role.id=ff521c95c8aa454ea3daa6bc36d055b1, scope.project.id=d8426986884141db8d183e5b9a859a3b, user.id=6f740aaf3cae44509c45bafbff8e9374) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:36.245887 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848c50c-135b-40e5-8562-1b7a68141a6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:36.247580 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848c50c-135b-40e5-8562-1b7a68141a6c None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:36.253994 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 47/91] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:02:36 2022] GET /identity/v3/role_assignments?user.id=6f740aaf3cae44509c45bafbff8e9374&scope.project.id=d8426986884141db8d183e5b9a859a3b&role.id=ff521c95c8aa454ea3daa6bc36d055b1 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:36.254906 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848c50c-135b-40e5-8562-1b7a68141a6c None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:36.377254 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da75d21-f415-4d7e-8321-bdb3b1a15443 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:36.381265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:36.386767 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:36.392191 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848c50c-135b-40e5-8562-1b7a68141a6c None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:36.429045 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4a0fc-4832-41eb-96d4-0f014e932a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:36.429721 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4a0fc-4832-41eb-96d4-0f014e932a07 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:36.430012 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4a0fc-4832-41eb-96d4-0f014e932a07 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:36.430370 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4a0fc-4832-41eb-96d4-0f014e932a07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:36.443125 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5871008-44c4-49f2-942d-b3c3b4fea7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:36.443970 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5871008-44c4-49f2-942d-b3c3b4fea7ea None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:36.444360 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5871008-44c4-49f2-942d-b3c3b4fea7ea None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:36.444739 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5871008-44c4-49f2-942d-b3c3b4fea7ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:36.449271 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5871008-44c4-49f2-942d-b3c3b4fea7ea None admin] RBAC: Adding query filter params (role.id=3ddf578e07094ecd820c44387851dbb8, scope.project.id=d8426986884141db8d183e5b9a859a3b, user.id=59ac1efaf68a45108260a4d69c510080) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:36.449271 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5871008-44c4-49f2-942d-b3c3b4fea7ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:36.449271 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5871008-44c4-49f2-942d-b3c3b4fea7ea None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:36.469423 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 48/92] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:02:36 2022] GET /identity/v3/role_assignments?user.id=59ac1efaf68a45108260a4d69c510080&scope.project.id=d8426986884141db8d183e5b9a859a3b&role.id=3ddf578e07094ecd820c44387851dbb8 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:36.469423 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5871008-44c4-49f2-942d-b3c3b4fea7ea None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:36.555362 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b4a0fc-4832-41eb-96d4-0f014e932a07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:36.557018 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b4a0fc-4832-41eb-96d4-0f014e932a07 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:36.627121 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5871008-44c4-49f2-942d-b3c3b4fea7ea None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:36.698716 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7454df-2d7a-4194-a8d2-366e7c163c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:36.699588 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7454df-2d7a-4194-a8d2-366e7c163c52 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:36.699874 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7454df-2d7a-4194-a8d2-366e7c163c52 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:36.700153 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7454df-2d7a-4194-a8d2-366e7c163c52 None admin] PATH_INFO: `/v3/projects/d8426986884141db8d183e5b9a859a3b` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:36.702484 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7454df-2d7a-4194-a8d2-366e7c163c52 None admin] RBAC: Authorizing `identity:get_project(project_id=d8426986884141db8d183e5b9a859a3b)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:36.704262 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7454df-2d7a-4194-a8d2-366e7c163c52 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:36.706682 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 49/93] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:02:36 2022] GET /identity/v3/projects/d8426986884141db8d183e5b9a859a3b => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:36.712789 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7454df-2d7a-4194-a8d2-366e7c163c52 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:36.714191 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 45/94] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:02:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:02:36.722662 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4a0fc-4832-41eb-96d4-0f014e932a07 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:36.724822 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:36.755556 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:36.839209 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7454df-2d7a-4194-a8d2-366e7c163c52 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:36.883444 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf3d78-654e-4627-a593-6e109e605eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:36.884136 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf3d78-654e-4627-a593-6e109e605eaa None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:36.884423 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf3d78-654e-4627-a593-6e109e605eaa None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:36.884702 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf3d78-654e-4627-a593-6e109e605eaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:36.885543 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf3d78-654e-4627-a593-6e109e605eaa None admin] RBAC: Adding query filter params (role.id=44e6a84e85f84d5ba38f6ee215622918, scope.project.id=d8426986884141db8d183e5b9a859a3b, user.id=59ac1efaf68a45108260a4d69c510080) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:36.885863 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf3d78-654e-4627-a593-6e109e605eaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:36.887825 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf3d78-654e-4627-a593-6e109e605eaa None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:36.894594 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 50/95] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:02:36 2022] GET /identity/v3/role_assignments?user.id=59ac1efaf68a45108260a4d69c510080&scope.project.id=d8426986884141db8d183e5b9a859a3b&role.id=44e6a84e85f84d5ba38f6ee215622918 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:36.917409 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4a0fc-4832-41eb-96d4-0f014e932a07 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:36.991991 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb444857-04ed-4565-9dcf-e70e0c597dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:36.993280 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb444857-04ed-4565-9dcf-e70e0c597dd0 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:36.993777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb444857-04ed-4565-9dcf-e70e0c597dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:36.994295 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb444857-04ed-4565-9dcf-e70e0c597dd0 None admin] PATH_INFO: `/v3/projects/4904a968d670464cabfb4fa7432ca105` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:36.995848 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb444857-04ed-4565-9dcf-e70e0c597dd0 None admin] RBAC: Authorizing `identity:get_project(project_id=4904a968d670464cabfb4fa7432ca105)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:36.997720 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb444857-04ed-4565-9dcf-e70e0c597dd0 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:36.999803 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 46/96] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:02:36 2022] GET /identity/v3/projects/4904a968d670464cabfb4fa7432ca105 => generated 312 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:37.006139 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf3d78-654e-4627-a593-6e109e605eaa None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:37.135726 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:37.143015 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf3d78-654e-4627-a593-6e109e605eaa None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:37.181849 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60016b7-8000-43c9-93d5-cb4c22e06cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:37.182702 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60016b7-8000-43c9-93d5-cb4c22e06cd1 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:37.183111 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60016b7-8000-43c9-93d5-cb4c22e06cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:37.183468 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60016b7-8000-43c9-93d5-cb4c22e06cd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:37.184669 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60016b7-8000-43c9-93d5-cb4c22e06cd1 None admin] RBAC: Adding query filter params (role.id=3ddf578e07094ecd820c44387851dbb8, scope.project.id=4904a968d670464cabfb4fa7432ca105, user.id=59ac1efaf68a45108260a4d69c510080) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:37.184991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60016b7-8000-43c9-93d5-cb4c22e06cd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:37.186480 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60016b7-8000-43c9-93d5-cb4c22e06cd1 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:37.193077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 51/97] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:02:37 2022] GET /identity/v3/role_assignments?user.id=59ac1efaf68a45108260a4d69c510080&scope.project.id=4904a968d670464cabfb4fa7432ca105&role.id=3ddf578e07094ecd820c44387851dbb8 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:39.488486 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a92c9-ed53-423c-90fe-74542697ebf0 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:39.489013 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a92c9-ed53-423c-90fe-74542697ebf0 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:39.489093 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a92c9-ed53-423c-90fe-74542697ebf0 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:39.490492 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 47/98] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:39.503722 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd533c-2c86-45fb-9b0f-0319930b2e1b None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:39.504648 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd533c-2c86-45fb-9b0f-0319930b2e1b None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:39.505130 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd533c-2c86-45fb-9b0f-0319930b2e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:39.526656 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-fefd533c-2c86-45fb-9b0f-0319930b2e1b None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:39.528249 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-fefd533c-2c86-45fb-9b0f-0319930b2e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:39.612443 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 52/99] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:39.649173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a92c9-ed53-423c-90fe-74542697ebf0 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:39.742708 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:39.784932 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a92c9-ed53-423c-90fe-74542697ebf0 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:39.832823 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914a9c7-8762-41a8-82ee-827f0c8ba1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:39.833649 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914a9c7-8762-41a8-82ee-827f0c8ba1fa None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:39.833939 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914a9c7-8762-41a8-82ee-827f0c8ba1fa None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:39.834227 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914a9c7-8762-41a8-82ee-827f0c8ba1fa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:39.848825 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914a9c7-8762-41a8-82ee-827f0c8ba1fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:39.856745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-8914a9c7-8762-41a8-82ee-827f0c8ba1fa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:02:39.856745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:39.856745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:39.856745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:39.856745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:39.856745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:39.856745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:39.856745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:39.856745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:39.856745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:39.856745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:39.856745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:39.856745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:39.856745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:39.856745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:39.856745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:39.857650 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:39.857650 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:39.857650 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:39.857650 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:39.857650 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:39.857650 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:39.857650 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:39.857650 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:39.857650 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:39.857650 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:39.857650 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:39.857650 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:02:39.857650 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:39.857650 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:39.857650 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:39.857650 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:39.858483 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:39.858483 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:39.858483 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:39.858483 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:39.858483 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:39.858483 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:39.858483 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:39.858483 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:39.858483 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:39.858483 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:39.858483 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:02:39.858483 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:02:39.858483 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 48/100] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:02:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:39.865004 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd533c-2c86-45fb-9b0f-0319930b2e1b None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:39.969514 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97990f32-bee1-450c-8522-72c41c9c11be None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:39.969847 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97990f32-bee1-450c-8522-72c41c9c11be None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:39.970080 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97990f32-bee1-450c-8522-72c41c9c11be None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:39.971777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 49/101] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:39.976429 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc346a3-2c33-4ccb-b20a-147960e98096 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:39.976714 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc346a3-2c33-4ccb-b20a-147960e98096 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:39.976999 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc346a3-2c33-4ccb-b20a-147960e98096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:39.998714 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:40.002480 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-0fc346a3-2c33-4ccb-b20a-147960e98096 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:40.003982 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-0fc346a3-2c33-4ccb-b20a-147960e98096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:40.024418 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd533c-2c86-45fb-9b0f-0319930b2e1b None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:40.089725 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63260b8-e220-487d-8de0-241cfb18348e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:40.090616 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63260b8-e220-487d-8de0-241cfb18348e None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:40.090904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63260b8-e220-487d-8de0-241cfb18348e None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:40.091504 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63260b8-e220-487d-8de0-241cfb18348e None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:40.092659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63260b8-e220-487d-8de0-241cfb18348e None admin] RBAC: Adding query filter params (name=reader) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:40.092975 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63260b8-e220-487d-8de0-241cfb18348e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:40.095105 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63260b8-e220-487d-8de0-241cfb18348e None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:40.104271 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 53/102] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:02:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:40.104623 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 50/103] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:02:40.106136 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0670c-f945-4e0e-bcc7-1cadf037ecdc None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:40.106341 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652ee40-fc46-414c-8b0a-df4452ac92a5 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:40.106448 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0670c-f945-4e0e-bcc7-1cadf037ecdc None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:40.106828 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0670c-f945-4e0e-bcc7-1cadf037ecdc None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:40.107011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652ee40-fc46-414c-8b0a-df4452ac92a5 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:40.107429 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652ee40-fc46-414c-8b0a-df4452ac92a5 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:40.108169 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 51/104] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:40.109429 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 54/105] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:40.115851 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0670c-f945-4e0e-bcc7-1cadf037ecdc None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:40.119429 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c3078-1c9e-4853-936f-0bd5f6cbe456 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:40.119724 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c3078-1c9e-4853-936f-0bd5f6cbe456 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:40.120009 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c3078-1c9e-4853-936f-0bd5f6cbe456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:40.153418 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-af7c3078-1c9e-4853-936f-0bd5f6cbe456 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:40.155816 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-af7c3078-1c9e-4853-936f-0bd5f6cbe456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:40.242670 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:40.254211 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 55/106] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 25 15:02:40.254211 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca7bad-afb4-4958-9036-c7f89086db18 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:40.254211 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca7bad-afb4-4958-9036-c7f89086db18 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:40.254211 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca7bad-afb4-4958-9036-c7f89086db18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:40.264885 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0670c-f945-4e0e-bcc7-1cadf037ecdc None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:40.288152 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-51ca7bad-afb4-4958-9036-c7f89086db18 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:40.290398 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-51ca7bad-afb4-4958-9036-c7f89086db18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:40.311482 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6a038-1a4d-47e6-b3e1-2d201ab2606b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:40.312385 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6a038-1a4d-47e6-b3e1-2d201ab2606b None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:40.312671 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6a038-1a4d-47e6-b3e1-2d201ab2606b None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:40.312952 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6a038-1a4d-47e6-b3e1-2d201ab2606b None admin] PATH_INFO: `/v3/users/eb14413f196b418fa8a35a3a4d919a77` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:40.327676 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6a038-1a4d-47e6-b3e1-2d201ab2606b None admin] RBAC: Authorizing `identity:get_user(user_id=eb14413f196b418fa8a35a3a4d919a77)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:40.329250 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6a038-1a4d-47e6-b3e1-2d201ab2606b None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:40.331047 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 52/107] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:40 2022] GET /identity/v3/users/eb14413f196b418fa8a35a3a4d919a77 => generated 289 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:40.335448 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6a038-1a4d-47e6-b3e1-2d201ab2606b None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:40.378269 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 56/108] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:40.378269 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca7bad-afb4-4958-9036-c7f89086db18 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:40.390737 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:40.433072 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6a038-1a4d-47e6-b3e1-2d201ab2606b None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:40.451159 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:40.469557 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e255e3-96ca-4b7a-a0cd-131275fa8203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:40.470409 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e255e3-96ca-4b7a-a0cd-131275fa8203 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:40.470686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e255e3-96ca-4b7a-a0cd-131275fa8203 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:40.470961 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e255e3-96ca-4b7a-a0cd-131275fa8203 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:40.480723 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca7bad-afb4-4958-9036-c7f89086db18 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:40.481099 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e255e3-96ca-4b7a-a0cd-131275fa8203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:40.489829 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-c5e255e3-96ca-4b7a-a0cd-131275fa8203 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:02:40.489829 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:40.489829 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:40.489829 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:40.489829 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:40.489829 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:40.489829 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:40.489829 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:40.489829 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:40.489829 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:40.489829 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:40.489829 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:40.489829 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:40.489829 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:40.489829 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:40.489829 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:40.491285 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:40.491285 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:40.491285 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:40.491285 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:40.491285 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:40.491285 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:40.491285 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:40.491285 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:40.491285 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:40.491285 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:40.491285 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:40.491285 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:02:40.491285 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:40.491285 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:40.491285 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:40.491285 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:40.492035 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:40.492035 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:40.492035 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:40.492035 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:40.492035 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:40.492035 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:40.492035 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:40.492035 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:40.492035 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:40.492035 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:40.492035 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:02:40.492035 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:02:40.492035 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 53/109] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:02:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:40.493690 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e255e3-96ca-4b7a-a0cd-131275fa8203 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:40.521704 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7c01a-b733-42ef-913d-295bb055e11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:40.522451 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7c01a-b733-42ef-913d-295bb055e11c None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:40.522735 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7c01a-b733-42ef-913d-295bb055e11c None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:40.523008 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7c01a-b733-42ef-913d-295bb055e11c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:40.524164 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7c01a-b733-42ef-913d-295bb055e11c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:40.525673 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7c01a-b733-42ef-913d-295bb055e11c None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:40.527308 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 57/110] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:02:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:40.528500 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecc49e-78f1-4bdb-8990-86671f7a90d3 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:40.528784 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecc49e-78f1-4bdb-8990-86671f7a90d3 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:40.529060 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecc49e-78f1-4bdb-8990-86671f7a90d3 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:40.530276 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 58/111] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:40.531324 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634a54a-ceea-4a18-9d86-c19096843eed None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:40.531605 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634a54a-ceea-4a18-9d86-c19096843eed None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:40.531879 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634a54a-ceea-4a18-9d86-c19096843eed None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:40.533259 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 59/112] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:40.534092 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634a54a-ceea-4a18-9d86-c19096843eed None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:40.607264 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e255e3-96ca-4b7a-a0cd-131275fa8203 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:40.617242 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:40.639249 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634a54a-ceea-4a18-9d86-c19096843eed None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:40.641893 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e48d53-4192-4bc9-90f3-92754f28f635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:40.642596 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e48d53-4192-4bc9-90f3-92754f28f635 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:40.642903 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e48d53-4192-4bc9-90f3-92754f28f635 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:40.643184 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e48d53-4192-4bc9-90f3-92754f28f635 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:40.674258 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cc263-39eb-4045-9970-af9bae6c9317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:40.675062 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cc263-39eb-4045-9970-af9bae6c9317 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:40.675348 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cc263-39eb-4045-9970-af9bae6c9317 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:40.675626 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cc263-39eb-4045-9970-af9bae6c9317 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:40.686073 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cc263-39eb-4045-9970-af9bae6c9317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:40.690092 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:40.693908 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-224cc263-39eb-4045-9970-af9bae6c9317 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:40.693908 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:40.693908 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:40.693908 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:40.693908 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:40.693908 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:40.693908 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:40.693908 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:40.693908 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:40.693908 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:40.693908 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:40.693908 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:40.693908 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:40.693908 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:40.693908 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:40.693908 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:40.694902 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:40.694902 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:40.694902 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:40.694902 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:40.694902 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:40.694902 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:40.694902 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:40.694902 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:40.694902 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:40.694902 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:40.694902 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:40.694902 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:02:40.694902 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:40.694902 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:40.694902 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:40.694902 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:40.701425 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:40.701425 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:40.701425 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:40.701425 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:40.701425 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:40.701425 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:40.701425 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:40.701425 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:40.701425 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:40.701425 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:40.701425 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:40.701425 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:02:40.701425 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 60/113] 10.222.0.39 () {56 vars in 1096 bytes} [Wed May 25 15:02:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:40.701425 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cc263-39eb-4045-9970-af9bae6c9317 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:40.713059 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e48d53-4192-4bc9-90f3-92754f28f635 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:40.714584 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e48d53-4192-4bc9-90f3-92754f28f635 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:40.796161 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cc263-39eb-4045-9970-af9bae6c9317 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:40.812823 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 54/114] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:02:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:02:40.813654 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e48d53-4192-4bc9-90f3-92754f28f635 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:40.831300 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4ca34-84d3-4104-bcd8-bc4b97fd80eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:40.831966 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4ca34-84d3-4104-bcd8-bc4b97fd80eb None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:40.832244 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4ca34-84d3-4104-bcd8-bc4b97fd80eb None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:40.832525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4ca34-84d3-4104-bcd8-bc4b97fd80eb None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:40.833288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4ca34-84d3-4104-bcd8-bc4b97fd80eb None admin] RBAC: Adding query filter params (name=member) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:40.833600 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4ca34-84d3-4104-bcd8-bc4b97fd80eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:40.835016 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4ca34-84d3-4104-bcd8-bc4b97fd80eb None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:40.844288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 61/115] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:02:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:40.845486 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f100b34-7bf5-4754-b89c-7fa14f949335 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:40.845778 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f100b34-7bf5-4754-b89c-7fa14f949335 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:40.846058 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f100b34-7bf5-4754-b89c-7fa14f949335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:40.851100 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:40.864902 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-7f100b34-7bf5-4754-b89c-7fa14f949335 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:40.866134 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-7f100b34-7bf5-4754-b89c-7fa14f949335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:40.894288 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:40.916545 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e48d53-4192-4bc9-90f3-92754f28f635 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:40.934714 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 62/116] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:40.940006 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214db1a-0bad-4bdd-8f0d-af6b50d54530 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:40.940283 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214db1a-0bad-4bdd-8f0d-af6b50d54530 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:40.940613 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214db1a-0bad-4bdd-8f0d-af6b50d54530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:40.954366 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897ccb3-807e-438c-af86-f411b57a2784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:40.955216 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897ccb3-807e-438c-af86-f411b57a2784 None admin] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:40.955571 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897ccb3-807e-438c-af86-f411b57a2784 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:40.955855 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f897ccb3-807e-438c-af86-f411b57a2784 None admin] PATH_INFO: `/v3/projects` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:40.956910 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897ccb3-807e-438c-af86-f411b57a2784 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:40.958110 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f897ccb3-807e-438c-af86-f411b57a2784 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:40.958741 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-f214db1a-0bad-4bdd-8f0d-af6b50d54530 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:40.959953 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-f214db1a-0bad-4bdd-8f0d-af6b50d54530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:40.984469 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 55/117] 10.222.0.39 () {60 vars in 1141 bytes} [Wed May 25 15:02:40 2022] POST /identity/v3/projects => generated 302 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:40.985387 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897ccb3-807e-438c-af86-f411b57a2784 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:41.050651 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 63/118] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:41.050651 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214db1a-0bad-4bdd-8f0d-af6b50d54530 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:41.125115 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f897ccb3-807e-438c-af86-f411b57a2784 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:41.128501 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:41.162360 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:41.170798 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39331a63-2842-4603-ad7d-c71554d6924b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:41.171999 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39331a63-2842-4603-ad7d-c71554d6924b None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.172464 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39331a63-2842-4603-ad7d-c71554d6924b None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.173081 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39331a63-2842-4603-ad7d-c71554d6924b None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.173953 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39331a63-2842-4603-ad7d-c71554d6924b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:41.174297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39331a63-2842-4603-ad7d-c71554d6924b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:41.176520 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39331a63-2842-4603-ad7d-c71554d6924b None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:41.178634 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214db1a-0bad-4bdd-8f0d-af6b50d54530 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:41.187401 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 56/119] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:02:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:41.188493 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39331a63-2842-4603-ad7d-c71554d6924b None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:41.219417 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5cc36-403f-42c9-a02a-4f2341a52c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:41.220327 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5cc36-403f-42c9-a02a-4f2341a52c87 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.220600 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5cc36-403f-42c9-a02a-4f2341a52c87 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.220877 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5cc36-403f-42c9-a02a-4f2341a52c87 None admin] PATH_INFO: `/v3/projects/d8426986884141db8d183e5b9a859a3b` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.222101 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5cc36-403f-42c9-a02a-4f2341a52c87 None admin] RBAC: Authorizing `identity:get_project(project_id=d8426986884141db8d183e5b9a859a3b)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:41.223605 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5cc36-403f-42c9-a02a-4f2341a52c87 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:41.225513 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 64/120] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:02:41 2022] GET /identity/v3/projects/d8426986884141db8d183e5b9a859a3b => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:41.226066 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5cc36-403f-42c9-a02a-4f2341a52c87 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:41.305662 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39331a63-2842-4603-ad7d-c71554d6924b None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:41.332736 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5cc36-403f-42c9-a02a-4f2341a52c87 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:41.341997 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb55678-7412-4aa0-bfed-85710c1f9d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:41.342913 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb55678-7412-4aa0-bfed-85710c1f9d85 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.343196 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb55678-7412-4aa0-bfed-85710c1f9d85 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.343471 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb55678-7412-4aa0-bfed-85710c1f9d85 None admin] PATH_INFO: `/v3/users/59ac1efaf68a45108260a4d69c510080` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.344679 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb55678-7412-4aa0-bfed-85710c1f9d85 None admin] RBAC: Authorizing `identity:get_user(user_id=59ac1efaf68a45108260a4d69c510080)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:41.346152 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb55678-7412-4aa0-bfed-85710c1f9d85 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:41.347965 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 57/121] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:41 2022] GET /identity/v3/users/59ac1efaf68a45108260a4d69c510080 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:41.352893 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb55678-7412-4aa0-bfed-85710c1f9d85 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:41.366925 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:41.375102 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239e88a-2e00-4fc2-9b80-f9736bcf60cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:41.375915 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239e88a-2e00-4fc2-9b80-f9736bcf60cb None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.376196 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239e88a-2e00-4fc2-9b80-f9736bcf60cb None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.376465 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239e88a-2e00-4fc2-9b80-f9736bcf60cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.387204 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239e88a-2e00-4fc2-9b80-f9736bcf60cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:41.395768 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-5239e88a-2e00-4fc2-9b80-f9736bcf60cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:02:41.395768 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:41.395768 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:41.395768 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:41.395768 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:41.395768 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:41.395768 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:41.395768 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:41.395768 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:41.395768 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:41.395768 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:41.395768 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:41.395768 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:41.395768 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:41.395768 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:41.395768 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:41.396643 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:41.396643 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:41.396643 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:41.396643 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:41.396643 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:41.396643 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:41.396643 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:41.396643 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:41.396643 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:41.396643 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:41.396643 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:41.396643 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:02:41.396643 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:41.396643 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:41.396643 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:41.396643 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:41.402533 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:41.402533 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:41.402533 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:41.402533 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:41.402533 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:41.402533 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:41.402533 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:41.402533 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:41.402533 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:41.402533 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:41.402533 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:02:41.402533 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:02:41.402533 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 65/122] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:02:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:41.402533 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239e88a-2e00-4fc2-9b80-f9736bcf60cb None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:41.429136 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:41.482379 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb55678-7412-4aa0-bfed-85710c1f9d85 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:41.515516 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239e88a-2e00-4fc2-9b80-f9736bcf60cb None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:41.521747 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85986cdb-54cd-44e3-9ed5-5c5f0cb044ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:41.522613 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85986cdb-54cd-44e3-9ed5-5c5f0cb044ac None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.522904 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85986cdb-54cd-44e3-9ed5-5c5f0cb044ac None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.523514 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85986cdb-54cd-44e3-9ed5-5c5f0cb044ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.533763 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85986cdb-54cd-44e3-9ed5-5c5f0cb044ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:41.542120 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-85986cdb-54cd-44e3-9ed5-5c5f0cb044ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:02:41.542120 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:41.542120 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:41.542120 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:41.542120 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:41.542120 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:41.542120 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:41.542120 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:41.542120 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:41.542120 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:41.542120 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:41.542120 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:41.542120 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:41.542120 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:41.542120 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:41.542120 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:41.542993 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:41.542993 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:41.542993 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:41.542993 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:41.542993 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:41.542993 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:41.542993 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:41.542993 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:41.542993 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:41.542993 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:41.542993 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:41.542993 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:02:41.542993 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:41.542993 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:41.542993 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:41.542993 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:41.548900 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:41.548900 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:41.548900 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:41.548900 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:41.548900 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:41.548900 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:41.548900 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:41.548900 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:41.548900 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:41.548900 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:41.548900 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:02:41.548900 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:02:41.548900 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 58/123] 10.222.0.39 () {56 vars in 1114 bytes} [Wed May 25 15:02:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:41.548900 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85986cdb-54cd-44e3-9ed5-5c5f0cb044ac None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:41.560455 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf0400-b0a8-4976-b26f-14fe43c23f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:41.561589 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf0400-b0a8-4976-b26f-14fe43c23f2c None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.562036 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf0400-b0a8-4976-b26f-14fe43c23f2c None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.562421 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf0400-b0a8-4976-b26f-14fe43c23f2c None admin] PATH_INFO: `/v3/users/6f740aaf3cae44509c45bafbff8e9374` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.563646 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf0400-b0a8-4976-b26f-14fe43c23f2c None admin] RBAC: Authorizing `identity:get_user(user_id=6f740aaf3cae44509c45bafbff8e9374)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:41.565119 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf0400-b0a8-4976-b26f-14fe43c23f2c None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:41.571296 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 66/124] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:41 2022] GET /identity/v3/users/6f740aaf3cae44509c45bafbff8e9374 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:41.571296 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf0400-b0a8-4976-b26f-14fe43c23f2c None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:41.631330 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:41.664869 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85986cdb-54cd-44e3-9ed5-5c5f0cb044ac None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:41.678402 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf0400-b0a8-4976-b26f-14fe43c23f2c None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:41.686724 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:41.702588 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a40fd-32d4-46e8-82ae-d725f897a92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:41.703266 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a40fd-32d4-46e8-82ae-d725f897a92a None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.703561 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a40fd-32d4-46e8-82ae-d725f897a92a None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.703848 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a40fd-32d4-46e8-82ae-d725f897a92a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.704686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a40fd-32d4-46e8-82ae-d725f897a92a None admin] RBAC: Adding query filter params (role.id=79ee931fb56e4180984d7b16ab42999f, scope.project.id=d8426986884141db8d183e5b9a859a3b, user.id=eb14413f196b418fa8a35a3a4d919a77) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:41.705020 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a40fd-32d4-46e8-82ae-d725f897a92a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:41.706518 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a40fd-32d4-46e8-82ae-d725f897a92a None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:41.712380 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 59/125] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:02:41 2022] GET /identity/v3/role_assignments?user.id=eb14413f196b418fa8a35a3a4d919a77&scope.project.id=d8426986884141db8d183e5b9a859a3b&role.id=79ee931fb56e4180984d7b16ab42999f => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:41.713017 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a40fd-32d4-46e8-82ae-d725f897a92a None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:41.715156 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf2d20-235d-4e5d-99cb-a1bc9f967030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:41.716186 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf2d20-235d-4e5d-99cb-a1bc9f967030 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.716478 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf2d20-235d-4e5d-99cb-a1bc9f967030 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.716754 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf2d20-235d-4e5d-99cb-a1bc9f967030 None admin] PATH_INFO: `/v3/projects/d8426986884141db8d183e5b9a859a3b` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.718039 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf2d20-235d-4e5d-99cb-a1bc9f967030 None admin] RBAC: Authorizing `identity:get_project(project_id=d8426986884141db8d183e5b9a859a3b)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:41.719549 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf2d20-235d-4e5d-99cb-a1bc9f967030 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:41.721502 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 67/126] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:02:41 2022] GET /identity/v3/projects/d8426986884141db8d183e5b9a859a3b => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:41.727128 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf2d20-235d-4e5d-99cb-a1bc9f967030 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:41.849985 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf2d20-235d-4e5d-99cb-a1bc9f967030 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:41.862711 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a40fd-32d4-46e8-82ae-d725f897a92a None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:41.879620 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:41.890410 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d16b43-afa2-4524-886f-bc54f3d552aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:41.891405 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d16b43-afa2-4524-886f-bc54f3d552aa None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.891868 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d16b43-afa2-4524-886f-bc54f3d552aa None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.892332 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d16b43-afa2-4524-886f-bc54f3d552aa None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.893108 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d16b43-afa2-4524-886f-bc54f3d552aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:41.893421 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d16b43-afa2-4524-886f-bc54f3d552aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:41.895018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d16b43-afa2-4524-886f-bc54f3d552aa None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:41.904753 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 68/127] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:02:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:41.905521 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d16b43-afa2-4524-886f-bc54f3d552aa None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:41.914631 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d626d1-ce55-4e31-bc1d-f36a9a2c0941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:41.916479 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d626d1-ce55-4e31-bc1d-f36a9a2c0941 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:41.916970 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d626d1-ce55-4e31-bc1d-f36a9a2c0941 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:41.917447 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d626d1-ce55-4e31-bc1d-f36a9a2c0941 None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:41.919832 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d626d1-ce55-4e31-bc1d-f36a9a2c0941 None admin] RBAC: Adding query filter params (name=member) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:41.920836 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d626d1-ce55-4e31-bc1d-f36a9a2c0941 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:41.922814 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d626d1-ce55-4e31-bc1d-f36a9a2c0941 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:41.937051 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 60/128] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:02:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:41.938301 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d626d1-ce55-4e31-bc1d-f36a9a2c0941 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.010038 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:42.029326 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d16b43-afa2-4524-886f-bc54f3d552aa None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.067646 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3af63a-8fb8-4b6a-933a-cc7007958212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.068841 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3af63a-8fb8-4b6a-933a-cc7007958212 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.069299 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3af63a-8fb8-4b6a-933a-cc7007958212 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.069746 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3af63a-8fb8-4b6a-933a-cc7007958212 None admin] PATH_INFO: `/v3/projects/d8426986884141db8d183e5b9a859a3b` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.071181 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3af63a-8fb8-4b6a-933a-cc7007958212 None admin] RBAC: Authorizing `identity:get_project(project_id=d8426986884141db8d183e5b9a859a3b)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.072927 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3af63a-8fb8-4b6a-933a-cc7007958212 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.075340 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 69/129] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:02:41 2022] GET /identity/v3/projects/d8426986884141db8d183e5b9a859a3b => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:42.076375 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3af63a-8fb8-4b6a-933a-cc7007958212 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.094910 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d626d1-ce55-4e31-bc1d-f36a9a2c0941 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.141658 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035123e-53ca-497e-86fe-6dfacdd9b5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.143026 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035123e-53ca-497e-86fe-6dfacdd9b5ee None admin] REQUEST_METHOD: `PUT` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.143499 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035123e-53ca-497e-86fe-6dfacdd9b5ee None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.143964 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035123e-53ca-497e-86fe-6dfacdd9b5ee None admin] PATH_INFO: `/v3/projects/d8426986884141db8d183e5b9a859a3b/users/59ac1efaf68a45108260a4d69c510080/roles/3ddf578e07094ecd820c44387851dbb8` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.146350 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035123e-53ca-497e-86fe-6dfacdd9b5ee None admin] RBAC: Authorizing `identity:create_grant(project_id=d8426986884141db8d183e5b9a859a3b, user_id=59ac1efaf68a45108260a4d69c510080, role_id=3ddf578e07094ecd820c44387851dbb8)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.148037 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035123e-53ca-497e-86fe-6dfacdd9b5ee None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.153971 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:42.163665 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 61/130] 10.222.0.39 () {58 vars in 1439 bytes} [Wed May 25 15:02:41 2022] PUT /identity/v3/projects/d8426986884141db8d183e5b9a859a3b/users/59ac1efaf68a45108260a4d69c510080/roles/3ddf578e07094ecd820c44387851dbb8 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:02:42.164917 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035123e-53ca-497e-86fe-6dfacdd9b5ee None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.209639 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3af63a-8fb8-4b6a-933a-cc7007958212 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.249932 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0474e1-9297-417e-ac7a-12ca52020076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.250849 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0474e1-9297-417e-ac7a-12ca52020076 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.251137 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0474e1-9297-417e-ac7a-12ca52020076 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.251418 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0474e1-9297-417e-ac7a-12ca52020076 None admin] PATH_INFO: `/v3/users/59ac1efaf68a45108260a4d69c510080` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.252665 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0474e1-9297-417e-ac7a-12ca52020076 None admin] RBAC: Authorizing `identity:get_user(user_id=59ac1efaf68a45108260a4d69c510080)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.254136 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0474e1-9297-417e-ac7a-12ca52020076 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.256155 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 70/131] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:42 2022] GET /identity/v3/users/59ac1efaf68a45108260a4d69c510080 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:42.256799 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0474e1-9297-417e-ac7a-12ca52020076 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.285622 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035123e-53ca-497e-86fe-6dfacdd9b5ee None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.295170 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:42.327974 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8ae08-6e6a-49dc-91e4-05e433a19b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.329319 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8ae08-6e6a-49dc-91e4-05e433a19b2f None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.329906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8ae08-6e6a-49dc-91e4-05e433a19b2f None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.330445 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8ae08-6e6a-49dc-91e4-05e433a19b2f None admin] PATH_INFO: `/v3/users/59ac1efaf68a45108260a4d69c510080` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.331975 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8ae08-6e6a-49dc-91e4-05e433a19b2f None admin] RBAC: Authorizing `identity:get_user(user_id=59ac1efaf68a45108260a4d69c510080)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.333667 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8ae08-6e6a-49dc-91e4-05e433a19b2f None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.335702 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 62/132] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:42 2022] GET /identity/v3/users/59ac1efaf68a45108260a4d69c510080 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:42.336729 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8ae08-6e6a-49dc-91e4-05e433a19b2f None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.395991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0474e1-9297-417e-ac7a-12ca52020076 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.438279 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:42.454279 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e14cb-ba6b-4a15-a612-fac2d57875b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.454279 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e14cb-ba6b-4a15-a612-fac2d57875b4 None admin] REQUEST_METHOD: `PUT` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.454279 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e14cb-ba6b-4a15-a612-fac2d57875b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.454279 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e14cb-ba6b-4a15-a612-fac2d57875b4 None admin] PATH_INFO: `/v3/projects/d8426986884141db8d183e5b9a859a3b/users/6f740aaf3cae44509c45bafbff8e9374/roles/ff521c95c8aa454ea3daa6bc36d055b1` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.456476 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e14cb-ba6b-4a15-a612-fac2d57875b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8426986884141db8d183e5b9a859a3b, user_id=6f740aaf3cae44509c45bafbff8e9374, role_id=ff521c95c8aa454ea3daa6bc36d055b1)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.457491 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e14cb-ba6b-4a15-a612-fac2d57875b4 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.483855 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 71/133] 10.222.0.39 () {58 vars in 1439 bytes} [Wed May 25 15:02:42 2022] PUT /identity/v3/projects/d8426986884141db8d183e5b9a859a3b/users/6f740aaf3cae44509c45bafbff8e9374/roles/ff521c95c8aa454ea3daa6bc36d055b1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:02:42.484966 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e14cb-ba6b-4a15-a612-fac2d57875b4 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.496891 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8ae08-6e6a-49dc-91e4-05e433a19b2f None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.540794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b0b5b-d42a-4d6a-bd3c-b549c01f6114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.541819 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b0b5b-d42a-4d6a-bd3c-b549c01f6114 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.542175 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b0b5b-d42a-4d6a-bd3c-b549c01f6114 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.542551 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b0b5b-d42a-4d6a-bd3c-b549c01f6114 None admin] PATH_INFO: `/v3/projects/d8426986884141db8d183e5b9a859a3b` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.544237 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b0b5b-d42a-4d6a-bd3c-b549c01f6114 None admin] RBAC: Authorizing `identity:get_project(project_id=d8426986884141db8d183e5b9a859a3b)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.546302 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b0b5b-d42a-4d6a-bd3c-b549c01f6114 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.548199 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 63/134] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:02:42 2022] GET /identity/v3/projects/d8426986884141db8d183e5b9a859a3b => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:42.554613 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b0b5b-d42a-4d6a-bd3c-b549c01f6114 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.607234 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:42.636686 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e14cb-ba6b-4a15-a612-fac2d57875b4 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.676194 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca0723-9e7f-4730-a733-9f63e238ecfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.677794 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca0723-9e7f-4730-a733-9f63e238ecfe None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.678324 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca0723-9e7f-4730-a733-9f63e238ecfe None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.678815 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca0723-9e7f-4730-a733-9f63e238ecfe None admin] PATH_INFO: `/v3/projects/4904a968d670464cabfb4fa7432ca105` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.680376 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca0723-9e7f-4730-a733-9f63e238ecfe None admin] RBAC: Authorizing `identity:get_project(project_id=4904a968d670464cabfb4fa7432ca105)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.682382 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca0723-9e7f-4730-a733-9f63e238ecfe None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.684529 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 72/135] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:02:42 2022] GET /identity/v3/projects/4904a968d670464cabfb4fa7432ca105 => generated 312 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:42.691335 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca0723-9e7f-4730-a733-9f63e238ecfe None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:42.711388 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b0b5b-d42a-4d6a-bd3c-b549c01f6114 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.753245 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828e49b-6caa-4c67-9d00-9f39088f5bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.754215 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828e49b-6caa-4c67-9d00-9f39088f5bc3 None admin] REQUEST_METHOD: `PUT` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.754542 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828e49b-6caa-4c67-9d00-9f39088f5bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.754817 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828e49b-6caa-4c67-9d00-9f39088f5bc3 None admin] PATH_INFO: `/v3/projects/d8426986884141db8d183e5b9a859a3b/users/59ac1efaf68a45108260a4d69c510080/roles/44e6a84e85f84d5ba38f6ee215622918` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.757120 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7828e49b-6caa-4c67-9d00-9f39088f5bc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8426986884141db8d183e5b9a859a3b, user_id=59ac1efaf68a45108260a4d69c510080, role_id=44e6a84e85f84d5ba38f6ee215622918)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.759438 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7828e49b-6caa-4c67-9d00-9f39088f5bc3 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.779725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 64/136] 10.222.0.39 () {58 vars in 1439 bytes} [Wed May 25 15:02:42 2022] PUT /identity/v3/projects/d8426986884141db8d183e5b9a859a3b/users/59ac1efaf68a45108260a4d69c510080/roles/44e6a84e85f84d5ba38f6ee215622918 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:02:42.786671 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:42.844618 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca0723-9e7f-4730-a733-9f63e238ecfe None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:42.882763 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa79fb4-6d66-4362-a784-8a5487e0dbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:42.883714 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa79fb4-6d66-4362-a784-8a5487e0dbfd None admin] REQUEST_METHOD: `PUT` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:42.884001 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa79fb4-6d66-4362-a784-8a5487e0dbfd None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:42.884271 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa79fb4-6d66-4362-a784-8a5487e0dbfd None admin] PATH_INFO: `/v3/projects/4904a968d670464cabfb4fa7432ca105/users/59ac1efaf68a45108260a4d69c510080/roles/3ddf578e07094ecd820c44387851dbb8` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:42.886341 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa79fb4-6d66-4362-a784-8a5487e0dbfd None admin] RBAC: Authorizing `identity:create_grant(project_id=4904a968d670464cabfb4fa7432ca105, user_id=59ac1efaf68a45108260a4d69c510080, role_id=3ddf578e07094ecd820c44387851dbb8)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:42.888053 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa79fb4-6d66-4362-a784-8a5487e0dbfd None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:42.912141 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 73/137] 10.222.0.39 () {58 vars in 1439 bytes} [Wed May 25 15:02:42 2022] PUT /identity/v3/projects/4904a968d670464cabfb4fa7432ca105/users/59ac1efaf68a45108260a4d69c510080/roles/3ddf578e07094ecd820c44387851dbb8 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:02:43.976635 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d71be-f499-4aeb-a01d-250a9aae4a4e None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.977149 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d71be-f499-4aeb-a01d-250a9aae4a4e None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.977221 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d71be-f499-4aeb-a01d-250a9aae4a4e None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:43.978711 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 65/138] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:43.984365 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744efb5c-bbb2-4672-9d93-440f35b03c52 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:43.984836 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744efb5c-bbb2-4672-9d93-440f35b03c52 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:43.984910 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744efb5c-bbb2-4672-9d93-440f35b03c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:44.009363 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-744efb5c-bbb2-4672-9d93-440f35b03c52 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:44.010603 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-744efb5c-bbb2-4672-9d93-440f35b03c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:44.107782 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 74/139] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:44.159282 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d71be-f499-4aeb-a01d-250a9aae4a4e None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:44.284381 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d71be-f499-4aeb-a01d-250a9aae4a4e None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:44.285887 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:44.329567 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b46ae-7cfa-4a26-8483-3c1291a9b361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:44.330407 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b46ae-7cfa-4a26-8483-3c1291a9b361 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:44.330692 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b46ae-7cfa-4a26-8483-3c1291a9b361 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:44.330969 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b46ae-7cfa-4a26-8483-3c1291a9b361 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:44.332138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b46ae-7cfa-4a26-8483-3c1291a9b361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:44.333651 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b46ae-7cfa-4a26-8483-3c1291a9b361 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:44.335974 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 66/140] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:02:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:44.342200 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744efb5c-bbb2-4672-9d93-440f35b03c52 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:44.396678 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:44.477937 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744efb5c-bbb2-4672-9d93-440f35b03c52 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:44.528371 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13921c1f-5b3e-4f37-96a3-bd8d837a247b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:44.529213 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13921c1f-5b3e-4f37-96a3-bd8d837a247b None admin] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:44.529498 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13921c1f-5b3e-4f37-96a3-bd8d837a247b None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:44.529775 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13921c1f-5b3e-4f37-96a3-bd8d837a247b None admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:44.530532 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13921c1f-5b3e-4f37-96a3-bd8d837a247b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:44.532009 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13921c1f-5b3e-4f37-96a3-bd8d837a247b None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:44.566162 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 75/141] 10.222.0.39 () {60 vars in 1132 bytes} [Wed May 25 15:02:44 2022] POST /identity/v3/users => generated 283 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:02:45.052771 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94bb09-ff64-4bc2-ad24-c2098cb976db None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.053252 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94bb09-ff64-4bc2-ad24-c2098cb976db None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.053252 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94bb09-ff64-4bc2-ad24-c2098cb976db None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.054629 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 67/142] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:45.060812 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0022ca9-c354-4b73-be12-6b2df12e0eab None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.061340 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0022ca9-c354-4b73-be12-6b2df12e0eab None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.061340 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0022ca9-c354-4b73-be12-6b2df12e0eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.087317 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-d0022ca9-c354-4b73-be12-6b2df12e0eab None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:45.088528 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-d0022ca9-c354-4b73-be12-6b2df12e0eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:45.179715 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 76/143] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:45.222371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94bb09-ff64-4bc2-ad24-c2098cb976db None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:45.355115 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94bb09-ff64-4bc2-ad24-c2098cb976db None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:45.403047 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951eda0-0e6d-45ee-9dba-0b0d603db73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:45.404868 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951eda0-0e6d-45ee-9dba-0b0d603db73d None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.405162 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951eda0-0e6d-45ee-9dba-0b0d603db73d None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.405442 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951eda0-0e6d-45ee-9dba-0b0d603db73d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.419946 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951eda0-0e6d-45ee-9dba-0b0d603db73d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:45.428265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-2951eda0-0e6d-45ee-9dba-0b0d603db73d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:02:45.428265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:45.428265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:45.428265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:45.428265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:45.428265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:45.428265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:45.428265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:45.428265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:45.428265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:45.428265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:45.428265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:45.428265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:45.428265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:45.428265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:45.428265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:45.429260 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:45.429260 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:45.429260 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:45.429260 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:45.429260 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:45.429260 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:45.429260 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:45.429260 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:45.429260 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:45.429260 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:45.429260 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:45.429260 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:02:45.429260 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:45.429260 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:45.429260 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:45.429260 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:45.430008 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:45.430008 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:45.430008 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:45.430008 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:45.430008 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:45.430008 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:45.430008 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:45.430008 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:45.430008 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:45.430008 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:45.430008 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:02:45.430008 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:02:45.430008 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 68/144] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:02:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:45.436855 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0022ca9-c354-4b73-be12-6b2df12e0eab None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:45.480378 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:45.574270 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0022ca9-c354-4b73-be12-6b2df12e0eab None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:45.594393 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cec52-6452-47bd-8107-85994322ce47 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.594704 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cec52-6452-47bd-8107-85994322ce47 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.594979 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cec52-6452-47bd-8107-85994322ce47 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.596574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 69/145] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:02:45.602035 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161d07c-898d-4457-ada0-db7c7af85348 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.602356 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161d07c-898d-4457-ada0-db7c7af85348 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.602657 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161d07c-898d-4457-ada0-db7c7af85348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.625416 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-0161d07c-898d-4457-ada0-db7c7af85348 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:45.626575 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-0161d07c-898d-4457-ada0-db7c7af85348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:45.630012 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42860339-ef0d-4c0a-81d3-42064ecd917f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:45.630742 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42860339-ef0d-4c0a-81d3-42064ecd917f None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.631085 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42860339-ef0d-4c0a-81d3-42064ecd917f None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.631365 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42860339-ef0d-4c0a-81d3-42064ecd917f None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.632188 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42860339-ef0d-4c0a-81d3-42064ecd917f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:45.632503 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42860339-ef0d-4c0a-81d3-42064ecd917f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:45.633955 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42860339-ef0d-4c0a-81d3-42064ecd917f None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:45.650538 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 77/146] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:02:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:45.658669 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42860339-ef0d-4c0a-81d3-42064ecd917f None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:45.666658 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:45.738932 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 70/147] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:02:45.781582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:45.788458 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799151ee-23d7-4daf-9344-59bcbb31d085 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.788752 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799151ee-23d7-4daf-9344-59bcbb31d085 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.789137 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799151ee-23d7-4daf-9344-59bcbb31d085 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.790788 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 71/148] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:02:45.792837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42860339-ef0d-4c0a-81d3-42064ecd917f None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:45.799964 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e79de-565a-4062-a897-3bdec021a99b None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.800375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e79de-565a-4062-a897-3bdec021a99b None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.800662 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e79de-565a-4062-a897-3bdec021a99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.826336 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-390e79de-565a-4062-a897-3bdec021a99b None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:45.828843 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-390e79de-565a-4062-a897-3bdec021a99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:45.834099 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c69203-d165-4d74-8178-db0533409c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:45.835039 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c69203-d165-4d74-8178-db0533409c62 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:45.835325 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c69203-d165-4d74-8178-db0533409c62 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:45.835607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c69203-d165-4d74-8178-db0533409c62 None admin] PATH_INFO: `/v3/users/eb14413f196b418fa8a35a3a4d919a77` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:45.838778 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c69203-d165-4d74-8178-db0533409c62 None admin] RBAC: Authorizing `identity:get_user(user_id=eb14413f196b418fa8a35a3a4d919a77)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:45.840282 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c69203-d165-4d74-8178-db0533409c62 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:45.842595 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 78/149] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:45 2022] GET /identity/v3/users/eb14413f196b418fa8a35a3a4d919a77 => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:45.843210 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c69203-d165-4d74-8178-db0533409c62 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:45.953556 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 72/150] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:02:45.954204 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e79de-565a-4062-a897-3bdec021a99b None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:46.065309 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c69203-d165-4d74-8178-db0533409c62 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:46.094633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:46.111244 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81493ed4-5082-463f-902f-b3094258680b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:46.112365 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81493ed4-5082-463f-902f-b3094258680b None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:46.112649 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81493ed4-5082-463f-902f-b3094258680b None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:46.112921 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81493ed4-5082-463f-902f-b3094258680b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:46.115722 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e79de-565a-4062-a897-3bdec021a99b None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:46.127320 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81493ed4-5082-463f-902f-b3094258680b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:46.135308 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-81493ed4-5082-463f-902f-b3094258680b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:46.135308 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:46.135308 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:46.135308 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:46.135308 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:46.135308 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:46.135308 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:46.135308 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:46.135308 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:46.135308 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:46.135308 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:46.135308 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:46.135308 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:46.135308 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:46.135308 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:46.135308 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:46.136190 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:46.136190 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:46.136190 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:46.136190 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:46.136190 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:46.136190 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:46.136190 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:46.136190 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:46.136190 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:46.136190 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:46.136190 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:46.136190 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:02:46.136190 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:46.136190 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:46.136190 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:46.136190 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:46.136951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:46.136951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:46.136951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:46.136951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:46.136951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:46.136951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:46.136951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:46.136951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:46.136951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:46.136951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:46.136951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:46.136951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:02:46.136951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 79/151] 10.222.0.39 () {56 vars in 1096 bytes} [Wed May 25 15:02:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:46.137581 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81493ed4-5082-463f-902f-b3094258680b None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:46.163659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:46.200348 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eedc77-16c6-45d5-af09-dcf8f30305de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:46.201546 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eedc77-16c6-45d5-af09-dcf8f30305de None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:46.201844 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eedc77-16c6-45d5-af09-dcf8f30305de None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:46.202131 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eedc77-16c6-45d5-af09-dcf8f30305de None admin] PATH_INFO: `/v3/projects/d8426986884141db8d183e5b9a859a3b` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:46.205311 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eedc77-16c6-45d5-af09-dcf8f30305de None admin] RBAC: Authorizing `identity:get_project(project_id=d8426986884141db8d183e5b9a859a3b)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:46.206882 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eedc77-16c6-45d5-af09-dcf8f30305de None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:46.208767 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 73/152] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:02:45 2022] GET /identity/v3/projects/d8426986884141db8d183e5b9a859a3b => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:46.209569 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eedc77-16c6-45d5-af09-dcf8f30305de None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:46.269026 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81493ed4-5082-463f-902f-b3094258680b None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:46.333710 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2e120-bebe-4502-9e15-d08f2c67d139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:46.334559 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2e120-bebe-4502-9e15-d08f2c67d139 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:46.334844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2e120-bebe-4502-9e15-d08f2c67d139 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:46.335120 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2e120-bebe-4502-9e15-d08f2c67d139 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:46.361215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2e120-bebe-4502-9e15-d08f2c67d139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:46.375439 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-d2d2e120-bebe-4502-9e15-d08f2c67d139 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:02:46.375439 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:46.375439 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:46.375439 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:46.375439 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:46.375439 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:46.375439 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:46.375439 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:46.375439 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:46.375439 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:46.375439 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:46.375439 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:46.375439 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:46.375439 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:46.375439 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:46.375439 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:46.376374 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:46.376374 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:46.376374 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:46.376374 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:46.376374 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:46.376374 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:46.376374 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:46.376374 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:46.376374 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:46.376374 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:46.376374 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:46.376374 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:02:46.376374 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:46.376374 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:46.376374 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:46.376374 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:46.377122 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:46.377122 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:46.377122 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:46.377122 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:46.377122 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:46.377122 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:46.377122 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:46.377122 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:46.377122 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:46.377122 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:46.377122 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:02:46.377122 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:02:46.377122 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 80/153] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:02:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:46.377980 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2e120-bebe-4502-9e15-d08f2c67d139 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:46.431141 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eedc77-16c6-45d5-af09-dcf8f30305de None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:46.517909 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1255a-10ed-4cb1-8e50-d942a892c541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:46.518557 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1255a-10ed-4cb1-8e50-d942a892c541 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:46.519261 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1255a-10ed-4cb1-8e50-d942a892c541 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:46.519542 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1255a-10ed-4cb1-8e50-d942a892c541 None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:46.520582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1255a-10ed-4cb1-8e50-d942a892c541 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:46.520890 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1255a-10ed-4cb1-8e50-d942a892c541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:46.522477 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1255a-10ed-4cb1-8e50-d942a892c541 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:46.538317 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 74/154] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:02:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:46.539162 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1255a-10ed-4cb1-8e50-d942a892c541 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:46.581607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:46.582119 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:46.640116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2e120-bebe-4502-9e15-d08f2c67d139 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:46.723099 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bde0ed-c1c7-493d-9294-4ee4d7ce88c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:46.724031 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bde0ed-c1c7-493d-9294-4ee4d7ce88c7 None admin] REQUEST_METHOD: `PUT` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:46.724320 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bde0ed-c1c7-493d-9294-4ee4d7ce88c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:46.724607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bde0ed-c1c7-493d-9294-4ee4d7ce88c7 None admin] PATH_INFO: `/v3/projects/d8426986884141db8d183e5b9a859a3b/users/eb14413f196b418fa8a35a3a4d919a77/roles/79ee931fb56e4180984d7b16ab42999f` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:46.731099 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bde0ed-c1c7-493d-9294-4ee4d7ce88c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8426986884141db8d183e5b9a859a3b, user_id=eb14413f196b418fa8a35a3a4d919a77, role_id=79ee931fb56e4180984d7b16ab42999f)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:46.732301 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1255a-10ed-4cb1-8e50-d942a892c541 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:46.732654 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bde0ed-c1c7-493d-9294-4ee4d7ce88c7 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:46.760523 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 81/155] 10.222.0.39 () {58 vars in 1439 bytes} [Wed May 25 15:02:46 2022] PUT /identity/v3/projects/d8426986884141db8d183e5b9a859a3b/users/eb14413f196b418fa8a35a3a4d919a77/roles/79ee931fb56e4180984d7b16ab42999f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:02:46.761380 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bde0ed-c1c7-493d-9294-4ee4d7ce88c7 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:46.787734 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73b3cc-1f04-41a5-bd53-4fa0a825572d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:46.788394 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73b3cc-1f04-41a5-bd53-4fa0a825572d None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:46.788638 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73b3cc-1f04-41a5-bd53-4fa0a825572d None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:46.788915 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73b3cc-1f04-41a5-bd53-4fa0a825572d None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:46.789694 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73b3cc-1f04-41a5-bd53-4fa0a825572d None admin] RBAC: Adding query filter params (name=member) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:46.789979 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73b3cc-1f04-41a5-bd53-4fa0a825572d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:46.791440 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73b3cc-1f04-41a5-bd53-4fa0a825572d None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:46.801176 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 75/156] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:02:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:46.806812 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf693bfa-993f-476f-9193-0bc641021e99 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:46.807129 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf693bfa-993f-476f-9193-0bc641021e99 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:46.807379 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf693bfa-993f-476f-9193-0bc641021e99 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:46.808861 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 76/157] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:46.815254 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf693bfa-993f-476f-9193-0bc641021e99 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:46.887897 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bde0ed-c1c7-493d-9294-4ee4d7ce88c7 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:46.927682 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e696020-d364-439e-8e79-f1592cdd7486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:46.928772 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e696020-d364-439e-8e79-f1592cdd7486 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:46.929057 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e696020-d364-439e-8e79-f1592cdd7486 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:46.929335 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e696020-d364-439e-8e79-f1592cdd7486 None admin] PATH_INFO: `/v3/users/6f740aaf3cae44509c45bafbff8e9374` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:46.930651 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e696020-d364-439e-8e79-f1592cdd7486 None admin] RBAC: Authorizing `identity:get_user(user_id=6f740aaf3cae44509c45bafbff8e9374)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:46.932781 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e696020-d364-439e-8e79-f1592cdd7486 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:46.934747 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 82/158] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:46 2022] GET /identity/v3/users/6f740aaf3cae44509c45bafbff8e9374 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:46.935990 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518553fe-ac9a-4f07-89ea-771c5cd098d8 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:46.936276 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518553fe-ac9a-4f07-89ea-771c5cd098d8 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:46.936733 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518553fe-ac9a-4f07-89ea-771c5cd098d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:46.953765 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:46.956679 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-518553fe-ac9a-4f07-89ea-771c5cd098d8 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:46.957982 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-518553fe-ac9a-4f07-89ea-771c5cd098d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:47.005960 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:47.043492 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 83/159] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:47.044813 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2d1c7-c8ad-4603-8838-64b9a673305e None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:47.045242 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2d1c7-c8ad-4603-8838-64b9a673305e None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:47.045666 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2d1c7-c8ad-4603-8838-64b9a673305e None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:47.052317 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 84/160] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:47.053195 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf693bfa-993f-476f-9193-0bc641021e99 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:47.053536 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2d1c7-c8ad-4603-8838-64b9a673305e None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:47.116430 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e55623-39a7-4357-83a4-a17286110b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:47.117350 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e55623-39a7-4357-83a4-a17286110b21 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:47.117630 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e55623-39a7-4357-83a4-a17286110b21 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:47.117904 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e55623-39a7-4357-83a4-a17286110b21 None admin] PATH_INFO: `/v3/users/59ac1efaf68a45108260a4d69c510080` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:47.119189 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e55623-39a7-4357-83a4-a17286110b21 None admin] RBAC: Authorizing `identity:get_user(user_id=59ac1efaf68a45108260a4d69c510080)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:47.120691 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e55623-39a7-4357-83a4-a17286110b21 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:47.122746 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 77/161] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:46 2022] GET /identity/v3/users/59ac1efaf68a45108260a4d69c510080 => generated 275 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:47.124013 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b1112-42f1-4a20-999d-3825b4a27cbb None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:47.124299 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b1112-42f1-4a20-999d-3825b4a27cbb None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:47.124575 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b1112-42f1-4a20-999d-3825b4a27cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:47.160350 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-349b1112-42f1-4a20-999d-3825b4a27cbb None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:47.161530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-349b1112-42f1-4a20-999d-3825b4a27cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:47.217675 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2d1c7-c8ad-4603-8838-64b9a673305e None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:47.257907 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f1cfe-09dd-466a-aa4b-282f38570958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:47.258757 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f1cfe-09dd-466a-aa4b-282f38570958 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:47.259044 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f1cfe-09dd-466a-aa4b-282f38570958 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:47.259322 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f1cfe-09dd-466a-aa4b-282f38570958 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:47.264132 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:47.372545 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 78/162] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:47.373225 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b1112-42f1-4a20-999d-3825b4a27cbb None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:47.432785 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f1cfe-09dd-466a-aa4b-282f38570958 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:47.434679 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f1cfe-09dd-466a-aa4b-282f38570958 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:47.561648 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:47.621450 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b1112-42f1-4a20-999d-3825b4a27cbb None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:47.694643 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523eb11b-76fd-4c0d-963a-93f62f226bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:47.695413 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523eb11b-76fd-4c0d-963a-93f62f226bc6 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:47.695750 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523eb11b-76fd-4c0d-963a-93f62f226bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:47.696037 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523eb11b-76fd-4c0d-963a-93f62f226bc6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:47.726862 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523eb11b-76fd-4c0d-963a-93f62f226bc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:47.744251 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-523eb11b-76fd-4c0d-963a-93f62f226bc6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:02:47.744251 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:47.744251 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:47.744251 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:47.744251 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:47.744251 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:47.744251 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:47.744251 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:47.744251 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:47.744251 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:47.744251 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:47.744251 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:47.744251 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:47.744251 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:47.744251 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:47.744251 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:47.745362 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:47.745362 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:47.745362 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:47.745362 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:47.745362 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:47.745362 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:47.745362 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:47.745362 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:47.745362 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:47.745362 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:47.745362 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:47.745362 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:02:47.745362 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:47.745362 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:47.745362 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:47.745362 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:47.746507 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:47.746507 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:47.746507 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:47.746507 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:47.746507 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:47.746507 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:47.746507 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:47.746507 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:47.746507 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:47.746507 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:47.746507 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:02:47.746507 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:02:47.746507 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 79/163] 10.222.0.39 () {56 vars in 1114 bytes} [Wed May 25 15:02:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:47.746507 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523eb11b-76fd-4c0d-963a-93f62f226bc6 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:47.781215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 85/164] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:02:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 728 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:02:47.782471 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f1cfe-09dd-466a-aa4b-282f38570958 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:47.902977 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:47.993211 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523eb11b-76fd-4c0d-963a-93f62f226bc6 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:48.047375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09028674-f28b-4afb-962b-e7935f84f3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:48.048042 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09028674-f28b-4afb-962b-e7935f84f3f1 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:48.048332 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09028674-f28b-4afb-962b-e7935f84f3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:48.048612 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09028674-f28b-4afb-962b-e7935f84f3f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:48.057109 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f1cfe-09dd-466a-aa4b-282f38570958 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:48.073578 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:48.135914 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efb2b9-4fa7-433c-b24a-2b09aead1cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:48.136741 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efb2b9-4fa7-433c-b24a-2b09aead1cc1 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:48.137021 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efb2b9-4fa7-433c-b24a-2b09aead1cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:48.137325 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4efb2b9-4fa7-433c-b24a-2b09aead1cc1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:48.155940 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4efb2b9-4fa7-433c-b24a-2b09aead1cc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:48.164089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-c4efb2b9-4fa7-433c-b24a-2b09aead1cc1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:02:48.164089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:48.164089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:48.164089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:48.164089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:48.164089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:48.164089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:48.164089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:48.164089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:48.164089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:48.164089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:48.164089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:48.164089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:48.164089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:48.164089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:48.164089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:48.164972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:48.164972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:48.164972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:48.164972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:48.164972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:48.164972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:48.164972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:48.164972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:48.164972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:48.164972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:48.164972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:48.164972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:02:48.164972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:48.164972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:48.164972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:48.164972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:48.165732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:48.165732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:48.165732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:48.165732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:48.165732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:48.165732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:48.165732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:48.165732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:48.165732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:48.165732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:48.165732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:02:48.165732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:02:48.165732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 86/165] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:02:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:48.166408 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efb2b9-4fa7-433c-b24a-2b09aead1cc1 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:48.191807 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09028674-f28b-4afb-962b-e7935f84f3f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:48.193329 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09028674-f28b-4afb-962b-e7935f84f3f1 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:48.293734 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:48.304069 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4efb2b9-4fa7-433c-b24a-2b09aead1cc1 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:48.363719 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 80/166] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:02:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:02:48.364657 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09028674-f28b-4afb-962b-e7935f84f3f1 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:48.367137 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690675d1-165d-4087-beb8-97682637a9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:48.367829 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690675d1-165d-4087-beb8-97682637a9da None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:48.368123 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690675d1-165d-4087-beb8-97682637a9da None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:48.368401 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690675d1-165d-4087-beb8-97682637a9da None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:48.369422 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690675d1-165d-4087-beb8-97682637a9da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:48.369735 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690675d1-165d-4087-beb8-97682637a9da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:48.371157 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690675d1-165d-4087-beb8-97682637a9da None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:48.387341 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 87/167] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:02:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:48.388408 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690675d1-165d-4087-beb8-97682637a9da None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:48.426666 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:48.525380 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09028674-f28b-4afb-962b-e7935f84f3f1 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:48.616348 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627eb6c-9a4f-4a83-b20c-772ad057c44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:48.617640 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627eb6c-9a4f-4a83-b20c-772ad057c44d None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:48.618116 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627eb6c-9a4f-4a83-b20c-772ad057c44d None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:48.618613 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627eb6c-9a4f-4a83-b20c-772ad057c44d None admin] PATH_INFO: `/v3/projects/d8426986884141db8d183e5b9a859a3b` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:48.623053 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627eb6c-9a4f-4a83-b20c-772ad057c44d None admin] RBAC: Authorizing `identity:get_project(project_id=d8426986884141db8d183e5b9a859a3b)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:48.623783 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690675d1-165d-4087-beb8-97682637a9da None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:48.624980 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627eb6c-9a4f-4a83-b20c-772ad057c44d None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:48.627254 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 81/168] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:02:48 2022] GET /identity/v3/projects/d8426986884141db8d183e5b9a859a3b => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:48.628238 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627eb6c-9a4f-4a83-b20c-772ad057c44d None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:48.675027 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e690fd6-3102-4a2f-a1d2-5a279c5b71d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:48.675725 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e690fd6-3102-4a2f-a1d2-5a279c5b71d1 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:48.676005 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e690fd6-3102-4a2f-a1d2-5a279c5b71d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:48.676280 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e690fd6-3102-4a2f-a1d2-5a279c5b71d1 None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:48.677129 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e690fd6-3102-4a2f-a1d2-5a279c5b71d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:48.677749 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e690fd6-3102-4a2f-a1d2-5a279c5b71d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:48.679193 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e690fd6-3102-4a2f-a1d2-5a279c5b71d1 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:48.692997 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 88/169] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:02:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:48.693929 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e690fd6-3102-4a2f-a1d2-5a279c5b71d1 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:48.734675 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:48.832586 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e690fd6-3102-4a2f-a1d2-5a279c5b71d1 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:48.854021 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627eb6c-9a4f-4a83-b20c-772ad057c44d None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:48.864229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:48.891497 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27aa217-d0f4-46e6-9328-071de5b7cdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:48.893126 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27aa217-d0f4-46e6-9328-071de5b7cdff None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:48.894868 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27aa217-d0f4-46e6-9328-071de5b7cdff None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:48.895288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27aa217-d0f4-46e6-9328-071de5b7cdff None admin] PATH_INFO: `/v3/users/59ac1efaf68a45108260a4d69c510080` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:48.896031 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdafcb-4916-47dd-b210-a723bcf9ae1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:48.897712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdafcb-4916-47dd-b210-a723bcf9ae1d None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:48.898532 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27aa217-d0f4-46e6-9328-071de5b7cdff None admin] RBAC: Authorizing `identity:get_user(user_id=59ac1efaf68a45108260a4d69c510080)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:48.900151 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27aa217-d0f4-46e6-9328-071de5b7cdff None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:48.900580 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdafcb-4916-47dd-b210-a723bcf9ae1d None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:48.900997 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdafcb-4916-47dd-b210-a723bcf9ae1d None admin] PATH_INFO: `/v3/projects/d8426986884141db8d183e5b9a859a3b` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:48.903458 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 89/170] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:48 2022] GET /identity/v3/users/59ac1efaf68a45108260a4d69c510080 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:48.904578 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdafcb-4916-47dd-b210-a723bcf9ae1d None admin] RBAC: Authorizing `identity:get_project(project_id=d8426986884141db8d183e5b9a859a3b)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:48.906180 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdafcb-4916-47dd-b210-a723bcf9ae1d None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:48.907177 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27aa217-d0f4-46e6-9328-071de5b7cdff None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:48.909063 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 82/171] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:02:48 2022] GET /identity/v3/projects/d8426986884141db8d183e5b9a859a3b => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:48.910455 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdafcb-4916-47dd-b210-a723bcf9ae1d None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:49.076881 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:49.098010 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdafcb-4916-47dd-b210-a723bcf9ae1d None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:49.101401 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27aa217-d0f4-46e6-9328-071de5b7cdff None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:49.165960 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78c8a3-3e96-48f5-8dd3-d2d1ed92b974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:49.166813 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78c8a3-3e96-48f5-8dd3-d2d1ed92b974 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:49.167098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78c8a3-3e96-48f5-8dd3-d2d1ed92b974 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:49.167375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78c8a3-3e96-48f5-8dd3-d2d1ed92b974 None admin] PATH_INFO: `/v3/users/59ac1efaf68a45108260a4d69c510080` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:49.168539 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419a3db-0604-4361-a663-7cc5052bb665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:49.169185 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419a3db-0604-4361-a663-7cc5052bb665 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:49.169505 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419a3db-0604-4361-a663-7cc5052bb665 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:49.169777 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2419a3db-0604-4361-a663-7cc5052bb665 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:49.170638 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419a3db-0604-4361-a663-7cc5052bb665 None admin] RBAC: Adding query filter params (role.id=ff521c95c8aa454ea3daa6bc36d055b1, scope.project.id=d8426986884141db8d183e5b9a859a3b, user.id=6f740aaf3cae44509c45bafbff8e9374) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:49.170954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419a3db-0604-4361-a663-7cc5052bb665 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:49.172417 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2419a3db-0604-4361-a663-7cc5052bb665 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:49.174981 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78c8a3-3e96-48f5-8dd3-d2d1ed92b974 None admin] RBAC: Authorizing `identity:get_user(user_id=59ac1efaf68a45108260a4d69c510080)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:49.176425 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78c8a3-3e96-48f5-8dd3-d2d1ed92b974 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:49.180956 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 83/172] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:48 2022] GET /identity/v3/users/59ac1efaf68a45108260a4d69c510080 => generated 275 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:49.181764 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78c8a3-3e96-48f5-8dd3-d2d1ed92b974 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:49.187424 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 90/173] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:02:48 2022] GET /identity/v3/role_assignments?user.id=6f740aaf3cae44509c45bafbff8e9374&scope.project.id=d8426986884141db8d183e5b9a859a3b&role.id=ff521c95c8aa454ea3daa6bc36d055b1 => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:49.188148 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419a3db-0604-4361-a663-7cc5052bb665 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:49.279884 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:49.400830 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78c8a3-3e96-48f5-8dd3-d2d1ed92b974 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:49.458706 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2419a3db-0604-4361-a663-7cc5052bb665 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:49.484049 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b7cf4-8ece-4046-ac93-d2aab7b60319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:49.484749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b7cf4-8ece-4046-ac93-d2aab7b60319 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:49.485034 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b7cf4-8ece-4046-ac93-d2aab7b60319 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:49.485310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b7cf4-8ece-4046-ac93-d2aab7b60319 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:49.535895 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5028c8-cd06-4d54-ad5d-a6e655a4968b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:49.536567 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5028c8-cd06-4d54-ad5d-a6e655a4968b None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:49.536850 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5028c8-cd06-4d54-ad5d-a6e655a4968b None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:49.537124 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5028c8-cd06-4d54-ad5d-a6e655a4968b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:49.537962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5028c8-cd06-4d54-ad5d-a6e655a4968b None admin] RBAC: Adding query filter params (role.id=3ddf578e07094ecd820c44387851dbb8, scope.project.id=d8426986884141db8d183e5b9a859a3b, user.id=59ac1efaf68a45108260a4d69c510080) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:49.538300 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5028c8-cd06-4d54-ad5d-a6e655a4968b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:49.539779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5028c8-cd06-4d54-ad5d-a6e655a4968b None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:49.551609 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 91/174] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:02:49 2022] GET /identity/v3/role_assignments?user.id=59ac1efaf68a45108260a4d69c510080&scope.project.id=d8426986884141db8d183e5b9a859a3b&role.id=3ddf578e07094ecd820c44387851dbb8 => generated 608 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:49.553281 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289914cc-b162-4bb3-a322-177fff1b35d4 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:49.553569 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289914cc-b162-4bb3-a322-177fff1b35d4 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:49.553843 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289914cc-b162-4bb3-a322-177fff1b35d4 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:49.566477 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 92/175] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:49 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:49.567387 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289914cc-b162-4bb3-a322-177fff1b35d4 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:49.610644 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:49.670507 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b7cf4-8ece-4046-ac93-d2aab7b60319 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:49.672095 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b7cf4-8ece-4046-ac93-d2aab7b60319 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:49.774402 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:49.841091 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289914cc-b162-4bb3-a322-177fff1b35d4 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:49.873592 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 84/176] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:02:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 692 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:02:49.875061 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9c025-52ef-4d3e-a66d-86277d4422ea None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:49.875357 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9c025-52ef-4d3e-a66d-86277d4422ea None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:49.875646 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9c025-52ef-4d3e-a66d-86277d4422ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:49.896613 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-87f9c025-52ef-4d3e-a66d-86277d4422ea None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:49.897825 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-87f9c025-52ef-4d3e-a66d-86277d4422ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:49.903858 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ed841-a751-4199-94c4-42868691db2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:49.905209 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ed841-a751-4199-94c4-42868691db2a None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:49.905610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ed841-a751-4199-94c4-42868691db2a None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:49.906187 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ed841-a751-4199-94c4-42868691db2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:49.990361 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 85/177] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:49.991487 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c9b2e-7df8-48f5-bbdc-a960e1bf9bff None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:49.991778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c9b2e-7df8-48f5-bbdc-a960e1bf9bff None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:49.992054 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c9b2e-7df8-48f5-bbdc-a960e1bf9bff None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:49.993435 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 86/178] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:49.998947 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2399e-05a7-4074-905a-a5cf59cf9169 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:49.998947 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2399e-05a7-4074-905a-a5cf59cf9169 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:49.998947 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2399e-05a7-4074-905a-a5cf59cf9169 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:49.998947 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 87/179] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:49.998947 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2399e-05a7-4074-905a-a5cf59cf9169 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:50.001749 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ed841-a751-4199-94c4-42868691db2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:50.003521 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ed841-a751-4199-94c4-42868691db2a None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:50.022974 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:50.086147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:50.114699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2399e-05a7-4074-905a-a5cf59cf9169 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:50.121074 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 93/180] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:02:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:02:50.121074 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd001a7-42d7-49fe-95e4-6dbab8363585 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:50.121074 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd001a7-42d7-49fe-95e4-6dbab8363585 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:50.121074 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd001a7-42d7-49fe-95e4-6dbab8363585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:50.136622 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-acd001a7-42d7-49fe-95e4-6dbab8363585 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:50.137831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-acd001a7-42d7-49fe-95e4-6dbab8363585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:50.153416 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b3066-2507-4cb7-afe0-c5241d1448c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:50.154493 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b3066-2507-4cb7-afe0-c5241d1448c9 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:50.154780 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b3066-2507-4cb7-afe0-c5241d1448c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:50.155053 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b3066-2507-4cb7-afe0-c5241d1448c9 None admin] PATH_INFO: `/v3/projects/d8426986884141db8d183e5b9a859a3b` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:50.156262 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b3066-2507-4cb7-afe0-c5241d1448c9 None admin] RBAC: Authorizing `identity:get_project(project_id=d8426986884141db8d183e5b9a859a3b)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:50.157736 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b3066-2507-4cb7-afe0-c5241d1448c9 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:50.162294 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 88/181] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:02:49 2022] GET /identity/v3/projects/d8426986884141db8d183e5b9a859a3b => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:50.162294 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aa001-8a30-4448-ab16-f439e40b39e9 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:50.162294 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aa001-8a30-4448-ab16-f439e40b39e9 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:50.162294 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aa001-8a30-4448-ab16-f439e40b39e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:50.178393 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-a72aa001-8a30-4448-ab16-f439e40b39e9 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:50.179581 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-a72aa001-8a30-4448-ab16-f439e40b39e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:50.210936 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 94/182] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:50.212888 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd001a7-42d7-49fe-95e4-6dbab8363585 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:50.245250 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 89/183] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:50.246098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72aa001-8a30-4448-ab16-f439e40b39e9 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:50.260823 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:50.318001 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd001a7-42d7-49fe-95e4-6dbab8363585 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:50.332251 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:50.355354 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f96d0e-0c30-49fa-8885-24fa1af8e386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:50.356086 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f96d0e-0c30-49fa-8885-24fa1af8e386 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:50.356372 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f96d0e-0c30-49fa-8885-24fa1af8e386 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:50.356652 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f96d0e-0c30-49fa-8885-24fa1af8e386 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:50.362128 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72aa001-8a30-4448-ab16-f439e40b39e9 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:50.367080 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f96d0e-0c30-49fa-8885-24fa1af8e386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:50.375116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-61f96d0e-0c30-49fa-8885-24fa1af8e386 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:50.375116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:50.375116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:50.375116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:50.375116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:50.375116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:50.375116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:50.375116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:50.375116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:50.375116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:50.375116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:50.375116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:50.375116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:50.375116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:50.375116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:50.375116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:50.376011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:50.376011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:50.376011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:50.376011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:50.376011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:50.376011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:50.376011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:50.376011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:50.376011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:50.376011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:50.376011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:50.376011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:02:50.376011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:50.376011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:50.376011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:50.376011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:50.376793 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:50.376793 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:50.376793 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:50.376793 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:50.376793 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:50.376793 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:50.376793 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:50.376793 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:50.376793 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:50.376793 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:50.376793 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:50.376793 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:02:50.376793 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 95/184] 10.222.0.39 () {56 vars in 1096 bytes} [Wed May 25 15:02:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:50.377479 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f96d0e-0c30-49fa-8885-24fa1af8e386 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:50.399608 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0a869-464b-4973-96b8-1cd8c0d6192a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:50.400494 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0a869-464b-4973-96b8-1cd8c0d6192a None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:50.400780 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0a869-464b-4973-96b8-1cd8c0d6192a None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:50.401056 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0a869-464b-4973-96b8-1cd8c0d6192a None admin] PATH_INFO: `/v3/projects/4904a968d670464cabfb4fa7432ca105` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:50.402257 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0a869-464b-4973-96b8-1cd8c0d6192a None admin] RBAC: Authorizing `identity:get_project(project_id=4904a968d670464cabfb4fa7432ca105)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:50.403754 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0a869-464b-4973-96b8-1cd8c0d6192a None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:50.405496 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 90/185] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:02:50 2022] GET /identity/v3/projects/4904a968d670464cabfb4fa7432ca105 => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:50.406764 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3eb99a-f442-4d59-98f9-a2b03f63842a None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:50.407055 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3eb99a-f442-4d59-98f9-a2b03f63842a None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:50.407332 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3eb99a-f442-4d59-98f9-a2b03f63842a None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:50.408550 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 91/186] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:50.413476 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3eb99a-f442-4d59-98f9-a2b03f63842a None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:50.488467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f96d0e-0c30-49fa-8885-24fa1af8e386 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:50.495879 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:50.517926 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3eb99a-f442-4d59-98f9-a2b03f63842a None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:50.524073 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595cd54-0372-446c-b692-0d57e8b93ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:50.524732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595cd54-0372-446c-b692-0d57e8b93ef0 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:50.525017 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595cd54-0372-446c-b692-0d57e8b93ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:50.525299 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595cd54-0372-446c-b692-0d57e8b93ef0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:50.526131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595cd54-0372-446c-b692-0d57e8b93ef0 None admin] RBAC: Adding query filter params (role.id=44e6a84e85f84d5ba38f6ee215622918, scope.project.id=d8426986884141db8d183e5b9a859a3b, user.id=59ac1efaf68a45108260a4d69c510080) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:50.526474 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595cd54-0372-446c-b692-0d57e8b93ef0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:50.527929 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595cd54-0372-446c-b692-0d57e8b93ef0 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:50.534028 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 96/187] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:02:50 2022] GET /identity/v3/role_assignments?user.id=59ac1efaf68a45108260a4d69c510080&scope.project.id=d8426986884141db8d183e5b9a859a3b&role.id=44e6a84e85f84d5ba38f6ee215622918 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:50.534866 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595cd54-0372-446c-b692-0d57e8b93ef0 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:50.559251 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39200cc1-46f9-415e-bf46-906166b13fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:50.561263 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39200cc1-46f9-415e-bf46-906166b13fa8 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:50.561789 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39200cc1-46f9-415e-bf46-906166b13fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:50.562606 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39200cc1-46f9-415e-bf46-906166b13fa8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:50.575410 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:50.580174 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39200cc1-46f9-415e-bf46-906166b13fa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:50.593229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-39200cc1-46f9-415e-bf46-906166b13fa8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:02:50.593229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:50.593229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:50.593229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:50.593229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:50.593229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:50.593229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:50.593229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:50.593229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:50.593229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:50.593229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:50.593229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:50.593229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:50.593229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:50.593229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:50.593229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:50.594310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:50.594310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:50.594310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:50.594310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:50.594310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:50.594310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:50.594310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:50.594310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:50.594310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:50.594310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:50.594310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:50.594310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:02:50.594310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:50.594310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:50.594310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:50.594310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:50.595325 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:50.595325 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:50.595325 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:50.595325 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:50.595325 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:50.595325 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:50.595325 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:50.595325 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:50.595325 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:50.595325 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:50.595325 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:02:50.595325 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:02:50.595325 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 92/188] 10.222.0.39 () {56 vars in 1114 bytes} [Wed May 25 15:02:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:50.596217 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39200cc1-46f9-415e-bf46-906166b13fa8 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:50.660204 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595cd54-0372-446c-b692-0d57e8b93ef0 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:50.706428 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8663ae0-9e53-45e8-bd0c-98db97817b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:50.707255 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8663ae0-9e53-45e8-bd0c-98db97817b76 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:50.707535 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8663ae0-9e53-45e8-bd0c-98db97817b76 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:50.707806 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8663ae0-9e53-45e8-bd0c-98db97817b76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:50.709090 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8663ae0-9e53-45e8-bd0c-98db97817b76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:50.710610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8663ae0-9e53-45e8-bd0c-98db97817b76 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:50.712474 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 97/189] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:02:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:50.713070 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8663ae0-9e53-45e8-bd0c-98db97817b76 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:50.725908 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39200cc1-46f9-415e-bf46-906166b13fa8 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:50.765906 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:50.767416 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18469d-afa4-428c-bf9b-10dff91755fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:50.768147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18469d-afa4-428c-bf9b-10dff91755fc None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:50.768535 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18469d-afa4-428c-bf9b-10dff91755fc None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:50.768819 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18469d-afa4-428c-bf9b-10dff91755fc None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:50.769585 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18469d-afa4-428c-bf9b-10dff91755fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:50.770327 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18469d-afa4-428c-bf9b-10dff91755fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:50.771684 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18469d-afa4-428c-bf9b-10dff91755fc None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:50.781725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 93/190] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:02:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:50.783139 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c72835-0639-4292-9e9f-dbb602d18c22 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:50.783895 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c72835-0639-4292-9e9f-dbb602d18c22 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:50.784177 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c72835-0639-4292-9e9f-dbb602d18c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:50.801760 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-c6c72835-0639-4292-9e9f-dbb602d18c22 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:50.803334 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-c6c72835-0639-4292-9e9f-dbb602d18c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:50.839911 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8663ae0-9e53-45e8-bd0c-98db97817b76 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:50.859555 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:50.870369 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 94/191] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:50.871277 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c72835-0639-4292-9e9f-dbb602d18c22 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:50.874713 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9472e1-af1c-4cf0-affe-ad1f85b046ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:50.875389 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9472e1-af1c-4cf0-affe-ad1f85b046ef None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:50.875675 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9472e1-af1c-4cf0-affe-ad1f85b046ef None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:50.875951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9472e1-af1c-4cf0-affe-ad1f85b046ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:50.876787 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9472e1-af1c-4cf0-affe-ad1f85b046ef None admin] RBAC: Adding query filter params (role.id=3ddf578e07094ecd820c44387851dbb8, scope.project.id=4904a968d670464cabfb4fa7432ca105, user.id=59ac1efaf68a45108260a4d69c510080) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:50.877103 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9472e1-af1c-4cf0-affe-ad1f85b046ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:50.878612 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9472e1-af1c-4cf0-affe-ad1f85b046ef None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:50.885108 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 98/192] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:02:50 2022] GET /identity/v3/role_assignments?user.id=59ac1efaf68a45108260a4d69c510080&scope.project.id=4904a968d670464cabfb4fa7432ca105&role.id=3ddf578e07094ecd820c44387851dbb8 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:50.885884 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9472e1-af1c-4cf0-affe-ad1f85b046ef None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:50.997452 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c72835-0639-4292-9e9f-dbb602d18c22 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:51.016442 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9472e1-af1c-4cf0-affe-ad1f85b046ef None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:51.018132 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:51.037019 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2d87b-918d-45ce-ba92-e9192164eadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:51.037706 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2d87b-918d-45ce-ba92-e9192164eadf None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:51.037989 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2d87b-918d-45ce-ba92-e9192164eadf None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:51.038289 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2d87b-918d-45ce-ba92-e9192164eadf None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:51.039057 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2d87b-918d-45ce-ba92-e9192164eadf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:51.039364 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2d87b-918d-45ce-ba92-e9192164eadf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:51.040785 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2d87b-918d-45ce-ba92-e9192164eadf None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:51.050729 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 95/193] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:02:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:51.055698 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2d87b-918d-45ce-ba92-e9192164eadf None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:51.057152 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073360a-a6a0-4144-82fe-a695c1c468c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:51.057849 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073360a-a6a0-4144-82fe-a695c1c468c4 None admin] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:51.058135 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073360a-a6a0-4144-82fe-a695c1c468c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:51.058442 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073360a-a6a0-4144-82fe-a695c1c468c4 None admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:51.059236 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073360a-a6a0-4144-82fe-a695c1c468c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:51.061605 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073360a-a6a0-4144-82fe-a695c1c468c4 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:51.084327 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 99/194] 10.222.0.39 () {60 vars in 1132 bytes} [Wed May 25 15:02:50 2022] POST /identity/v3/users => generated 297 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:51.085919 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073360a-a6a0-4144-82fe-a695c1c468c4 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:51.132100 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:51.198758 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2d87b-918d-45ce-ba92-e9192164eadf None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:51.218446 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073360a-a6a0-4144-82fe-a695c1c468c4 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:51.238421 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc0d08-9c18-4afc-bbab-3859a06fda53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:51.239330 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc0d08-9c18-4afc-bbab-3859a06fda53 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:51.239616 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc0d08-9c18-4afc-bbab-3859a06fda53 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:51.240044 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc0d08-9c18-4afc-bbab-3859a06fda53 None admin] PATH_INFO: `/v3/users/8e4f3d4a91534dc3b430fbf3c54b49de` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:51.255651 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be67623-7de1-4308-8c2c-a8b614b58c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:51.255866 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc0d08-9c18-4afc-bbab-3859a06fda53 None admin] RBAC: Authorizing `identity:get_user(user_id=8e4f3d4a91534dc3b430fbf3c54b49de)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:51.256388 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be67623-7de1-4308-8c2c-a8b614b58c0e None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:51.256675 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be67623-7de1-4308-8c2c-a8b614b58c0e None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:51.256951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be67623-7de1-4308-8c2c-a8b614b58c0e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:51.257167 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc0d08-9c18-4afc-bbab-3859a06fda53 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:51.259171 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 96/195] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:51 2022] GET /identity/v3/users/8e4f3d4a91534dc3b430fbf3c54b49de => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:51.259171 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc0d08-9c18-4afc-bbab-3859a06fda53 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:51.275205 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be67623-7de1-4308-8c2c-a8b614b58c0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:51.283250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-8be67623-7de1-4308-8c2c-a8b614b58c0e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:02:51.283250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:51.283250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:51.283250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:51.283250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:51.283250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:51.283250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:51.283250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:51.283250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:51.283250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:51.283250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:51.283250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:51.283250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:51.283250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:51.283250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:51.283250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:51.284140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:51.284140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:51.284140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:51.284140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:51.284140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:51.284140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:51.284140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:51.284140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:51.284140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:51.284140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:51.284140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:51.284140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:02:51.284140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:51.284140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:51.284140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:51.284140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:51.284914 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:51.284914 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:51.284914 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:51.284914 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:51.284914 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:51.284914 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:51.284914 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:51.284914 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:51.284914 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:51.284914 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:51.284914 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:02:51.284914 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:02:51.285515 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 100/196] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:02:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:51.286518 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be67623-7de1-4308-8c2c-a8b614b58c0e None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:51.311264 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:51.386360 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc0d08-9c18-4afc-bbab-3859a06fda53 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:51.404513 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:51.422507 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be67623-7de1-4308-8c2c-a8b614b58c0e None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:51.433500 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022fa3d-661e-4501-99ca-8208497ff83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:51.434801 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022fa3d-661e-4501-99ca-8208497ff83b None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:51.435108 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022fa3d-661e-4501-99ca-8208497ff83b None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:51.435599 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022fa3d-661e-4501-99ca-8208497ff83b None admin] PATH_INFO: `/v3/users/8e4f3d4a91534dc3b430fbf3c54b49de` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:51.438906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022fa3d-661e-4501-99ca-8208497ff83b None admin] RBAC: Authorizing `identity:get_user(user_id=8e4f3d4a91534dc3b430fbf3c54b49de)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:51.439272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022fa3d-661e-4501-99ca-8208497ff83b None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:51.441119 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 97/197] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:51 2022] GET /identity/v3/users/8e4f3d4a91534dc3b430fbf3c54b49de => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:51.441801 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022fa3d-661e-4501-99ca-8208497ff83b None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:51.461729 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee600ff-4cf7-485c-851f-729d961cb0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:51.462434 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee600ff-4cf7-485c-851f-729d961cb0e5 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:51.464089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee600ff-4cf7-485c-851f-729d961cb0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:51.464089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee600ff-4cf7-485c-851f-729d961cb0e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:51.548135 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee600ff-4cf7-485c-851f-729d961cb0e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:51.551146 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee600ff-4cf7-485c-851f-729d961cb0e5 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:51.568779 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022fa3d-661e-4501-99ca-8208497ff83b None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:51.577621 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:51.608458 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bcb04-ff34-4d02-ae81-bb48552f40ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:51.609173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bcb04-ff34-4d02-ae81-bb48552f40ec None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:51.609456 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bcb04-ff34-4d02-ae81-bb48552f40ec None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:51.609733 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bcb04-ff34-4d02-ae81-bb48552f40ec None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:51.610573 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bcb04-ff34-4d02-ae81-bb48552f40ec None admin] RBAC: Adding query filter params (name=reader) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:51.611002 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bcb04-ff34-4d02-ae81-bb48552f40ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:51.612685 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bcb04-ff34-4d02-ae81-bb48552f40ec None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:51.621783 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 98/198] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:02:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:51.627051 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bcb04-ff34-4d02-ae81-bb48552f40ec None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:51.676839 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:51.696982 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 101/199] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:02:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:02:51.698208 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee600ff-4cf7-485c-851f-729d961cb0e5 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:51.764840 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bcb04-ff34-4d02-ae81-bb48552f40ec None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:51.808848 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94aba1-ef27-432a-bb43-2409ad44fac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:51.810567 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94aba1-ef27-432a-bb43-2409ad44fac4 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:51.811105 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94aba1-ef27-432a-bb43-2409ad44fac4 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:51.811903 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94aba1-ef27-432a-bb43-2409ad44fac4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:51.815464 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee600ff-4cf7-485c-851f-729d961cb0e5 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:51.838538 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:51.857931 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd30a8-c742-4be1-8942-beb8577267b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:51.858865 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd30a8-c742-4be1-8942-beb8577267b6 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:51.859150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd30a8-c742-4be1-8942-beb8577267b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:51.859427 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd30a8-c742-4be1-8942-beb8577267b6 None admin] PATH_INFO: `/v3/users/eb14413f196b418fa8a35a3a4d919a77` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:51.860643 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd30a8-c742-4be1-8942-beb8577267b6 None admin] RBAC: Authorizing `identity:get_user(user_id=eb14413f196b418fa8a35a3a4d919a77)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:51.862091 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd30a8-c742-4be1-8942-beb8577267b6 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:51.863882 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 102/200] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:51 2022] GET /identity/v3/users/eb14413f196b418fa8a35a3a4d919a77 => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:51.869137 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd30a8-c742-4be1-8942-beb8577267b6 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:51.908972 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94aba1-ef27-432a-bb43-2409ad44fac4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:51.910775 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94aba1-ef27-432a-bb43-2409ad44fac4 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:51.954908 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:51.990276 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd30a8-c742-4be1-8942-beb8577267b6 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:52.023472 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 99/201] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:02:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:02:52.024365 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94aba1-ef27-432a-bb43-2409ad44fac4 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:52.028133 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08653022-8d5f-4475-aedb-932727f05939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:52.029709 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08653022-8d5f-4475-aedb-932727f05939 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:52.030204 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08653022-8d5f-4475-aedb-932727f05939 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:52.030708 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08653022-8d5f-4475-aedb-932727f05939 None admin] PATH_INFO: `/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:52.032181 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08653022-8d5f-4475-aedb-932727f05939 None admin] RBAC: Authorizing `identity:get_project(project_id=5ffc3171df904ff0a47f7fb65d9090cb)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:52.033849 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08653022-8d5f-4475-aedb-932727f05939 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:52.035869 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 103/202] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:02:51 2022] GET /identity/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:52.036847 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08653022-8d5f-4475-aedb-932727f05939 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:52.115929 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:52.158317 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94aba1-ef27-432a-bb43-2409ad44fac4 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:52.173742 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08653022-8d5f-4475-aedb-932727f05939 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:52.197868 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee4e71-65ce-4ece-9804-fa622dfd129b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:52.198841 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee4e71-65ce-4ece-9804-fa622dfd129b None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:52.198949 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee4e71-65ce-4ece-9804-fa622dfd129b None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:52.199196 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee4e71-65ce-4ece-9804-fa622dfd129b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:52.210130 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae447ca0-7af9-422e-8678-d15fd7ce06b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:52.211324 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae447ca0-7af9-422e-8678-d15fd7ce06b0 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:52.211814 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae447ca0-7af9-422e-8678-d15fd7ce06b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:52.212288 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:52.212519 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae447ca0-7af9-422e-8678-d15fd7ce06b0 None admin] PATH_INFO: `/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:52.213966 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae447ca0-7af9-422e-8678-d15fd7ce06b0 None admin] RBAC: Authorizing `identity:get_project(project_id=5ffc3171df904ff0a47f7fb65d9090cb)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:52.215936 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae447ca0-7af9-422e-8678-d15fd7ce06b0 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:52.218580 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 104/203] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:02:52 2022] GET /identity/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:52.219572 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae447ca0-7af9-422e-8678-d15fd7ce06b0 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:52.284567 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee4e71-65ce-4ece-9804-fa622dfd129b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:52.286972 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee4e71-65ce-4ece-9804-fa622dfd129b None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:52.345666 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae447ca0-7af9-422e-8678-d15fd7ce06b0 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:52.374326 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:52.390283 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367338f-1eae-4bfa-a4db-fe637dc59269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:52.391213 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367338f-1eae-4bfa-a4db-fe637dc59269 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:52.391499 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367338f-1eae-4bfa-a4db-fe637dc59269 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:52.391769 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367338f-1eae-4bfa-a4db-fe637dc59269 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:52.392610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367338f-1eae-4bfa-a4db-fe637dc59269 None admin] RBAC: Adding query filter params (role.id=ff521c95c8aa454ea3daa6bc36d055b1, scope.project.id=5ffc3171df904ff0a47f7fb65d9090cb, user.id=8e4f3d4a91534dc3b430fbf3c54b49de) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:52.393225 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367338f-1eae-4bfa-a4db-fe637dc59269 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:52.395096 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367338f-1eae-4bfa-a4db-fe637dc59269 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:52.406464 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 105/204] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:02:52 2022] GET /identity/v3/role_assignments?user.id=8e4f3d4a91534dc3b430fbf3c54b49de&scope.project.id=5ffc3171df904ff0a47f7fb65d9090cb&role.id=ff521c95c8aa454ea3daa6bc36d055b1 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:52.407487 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367338f-1eae-4bfa-a4db-fe637dc59269 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:52.437990 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 100/205] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:02:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:02:52.444101 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee4e71-65ce-4ece-9804-fa622dfd129b None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:52.530721 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:52.609111 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367338f-1eae-4bfa-a4db-fe637dc59269 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:52.660089 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee4e71-65ce-4ece-9804-fa622dfd129b None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:52.685236 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ca01f-1d3d-466b-bc45-05bf9c8aab9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:52.686387 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ca01f-1d3d-466b-bc45-05bf9c8aab9a None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:52.686886 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ca01f-1d3d-466b-bc45-05bf9c8aab9a None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:52.687370 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ca01f-1d3d-466b-bc45-05bf9c8aab9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:52.688450 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ca01f-1d3d-466b-bc45-05bf9c8aab9a None admin] RBAC: Adding query filter params (role.id=44e6a84e85f84d5ba38f6ee215622918, scope.project.id=5ffc3171df904ff0a47f7fb65d9090cb, user.id=8e4f3d4a91534dc3b430fbf3c54b49de) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:52.689000 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ca01f-1d3d-466b-bc45-05bf9c8aab9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:52.690690 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ca01f-1d3d-466b-bc45-05bf9c8aab9a None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:52.697468 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 106/206] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:02:52 2022] GET /identity/v3/role_assignments?user.id=8e4f3d4a91534dc3b430fbf3c54b49de&scope.project.id=5ffc3171df904ff0a47f7fb65d9090cb&role.id=44e6a84e85f84d5ba38f6ee215622918 => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:52.756538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64a57d-1a46-459c-a8b5-49bbbfd9f720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:52.757479 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64a57d-1a46-459c-a8b5-49bbbfd9f720 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:52.757762 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64a57d-1a46-459c-a8b5-49bbbfd9f720 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:52.758039 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64a57d-1a46-459c-a8b5-49bbbfd9f720 None admin] PATH_INFO: `/v3/projects/d8426986884141db8d183e5b9a859a3b` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:52.766172 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64a57d-1a46-459c-a8b5-49bbbfd9f720 None admin] RBAC: Authorizing `identity:get_project(project_id=d8426986884141db8d183e5b9a859a3b)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:52.767713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64a57d-1a46-459c-a8b5-49bbbfd9f720 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:52.769813 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 101/207] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:02:52 2022] GET /identity/v3/projects/d8426986884141db8d183e5b9a859a3b => generated 298 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:52.777099 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ca01f-1d3d-466b-bc45-05bf9c8aab9a None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:52.870985 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:52.948633 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ca01f-1d3d-466b-bc45-05bf9c8aab9a None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:52.991016 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c9c7d-bcab-4a18-9433-c90ead9096a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:52.991691 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c9c7d-bcab-4a18-9433-c90ead9096a3 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:52.991971 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c9c7d-bcab-4a18-9433-c90ead9096a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:52.992246 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c9c7d-bcab-4a18-9433-c90ead9096a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:52.993088 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c9c7d-bcab-4a18-9433-c90ead9096a3 None admin] RBAC: Adding query filter params (role.id=79ee931fb56e4180984d7b16ab42999f, scope.project.id=d8426986884141db8d183e5b9a859a3b, user.id=eb14413f196b418fa8a35a3a4d919a77) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:52.993398 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c9c7d-bcab-4a18-9433-c90ead9096a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:52.995091 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c9c7d-bcab-4a18-9433-c90ead9096a3 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:53.003336 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 107/208] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:02:52 2022] GET /identity/v3/role_assignments?user.id=eb14413f196b418fa8a35a3a4d919a77&scope.project.id=d8426986884141db8d183e5b9a859a3b&role.id=79ee931fb56e4180984d7b16ab42999f => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:53.788565 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde828ee-b709-40c4-b2df-a7a18c7b5471 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:53.789250 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde828ee-b709-40c4-b2df-a7a18c7b5471 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:53.789250 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde828ee-b709-40c4-b2df-a7a18c7b5471 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:53.790658 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 102/209] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:53.796178 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10020a0-bd2d-4e61-852c-2c9c0d585eac None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:53.796857 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10020a0-bd2d-4e61-852c-2c9c0d585eac None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:53.796857 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10020a0-bd2d-4e61-852c-2c9c0d585eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:53.817518 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-c10020a0-bd2d-4e61-852c-2c9c0d585eac None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:53.819019 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-c10020a0-bd2d-4e61-852c-2c9c0d585eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:53.829839 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f38399-f7b0-4109-a911-47cbc43b5e58 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:53.830150 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f38399-f7b0-4109-a911-47cbc43b5e58 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:53.830535 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f38399-f7b0-4109-a911-47cbc43b5e58 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:53.832081 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 103/210] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:02:53.840916 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4325cc-ef5e-47d0-9919-a30667eb9481 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:53.841210 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4325cc-ef5e-47d0-9919-a30667eb9481 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:53.841489 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4325cc-ef5e-47d0-9919-a30667eb9481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:53.859967 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-ab4325cc-ef5e-47d0-9919-a30667eb9481 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:53.861511 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-ab4325cc-ef5e-47d0-9919-a30667eb9481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:53.902038 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 108/211] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:02:53.929776 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10020a0-bd2d-4e61-852c-2c9c0d585eac None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:53.946383 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 104/212] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:53.972943 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4325cc-ef5e-47d0-9919-a30667eb9481 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:53.985577 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:54.023483 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:54.075117 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10020a0-bd2d-4e61-852c-2c9c0d585eac None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:54.103108 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4325cc-ef5e-47d0-9919-a30667eb9481 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:54.112696 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d545cc7-cfb9-4809-8c8a-c8b3fc406a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:54.113585 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d545cc7-cfb9-4809-8c8a-c8b3fc406a42 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:54.113939 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d545cc7-cfb9-4809-8c8a-c8b3fc406a42 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:54.114308 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d545cc7-cfb9-4809-8c8a-c8b3fc406a42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:54.115561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d545cc7-cfb9-4809-8c8a-c8b3fc406a42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:54.117095 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d545cc7-cfb9-4809-8c8a-c8b3fc406a42 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:54.123204 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 109/213] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:02:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:54.124900 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d545cc7-cfb9-4809-8c8a-c8b3fc406a42 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:54.156795 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9a6cb-087a-4b49-88a2-7a24b97ba518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:54.158472 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9a6cb-087a-4b49-88a2-7a24b97ba518 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:54.159197 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9a6cb-087a-4b49-88a2-7a24b97ba518 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:54.159621 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9a6cb-087a-4b49-88a2-7a24b97ba518 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:54.173629 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9a6cb-087a-4b49-88a2-7a24b97ba518 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:54.183906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-2bf9a6cb-087a-4b49-88a2-7a24b97ba518 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:02:54.183906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:54.183906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:54.183906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:54.183906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:54.183906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:54.183906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:54.183906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:54.183906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:54.183906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:54.183906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:54.183906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:54.183906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:54.183906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:54.183906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:54.183906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:54.184897 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:54.184897 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:54.184897 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:54.184897 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:54.184897 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:54.184897 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:54.184897 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:54.184897 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:54.184897 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:54.184897 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:54.184897 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:54.184897 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:02:54.184897 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:54.184897 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:54.184897 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:54.184897 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:54.185745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:54.185745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:54.185745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:54.185745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:54.185745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:54.185745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:54.185745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:54.185745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:54.185745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:54.185745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:54.185745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:02:54.185745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:02:54.186374 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 105/214] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:02:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:02:54.192451 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9a6cb-087a-4b49-88a2-7a24b97ba518 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:54.252729 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d545cc7-cfb9-4809-8c8a-c8b3fc406a42 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:54.273751 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:54.295981 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031df87-360e-413d-be71-c5aa416ee580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:54.296687 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031df87-360e-413d-be71-c5aa416ee580 None admin] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:54.296970 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031df87-360e-413d-be71-c5aa416ee580 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:54.297248 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031df87-360e-413d-be71-c5aa416ee580 None admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:54.297970 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031df87-360e-413d-be71-c5aa416ee580 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:54.299923 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031df87-360e-413d-be71-c5aa416ee580 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:54.312646 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9a6cb-087a-4b49-88a2-7a24b97ba518 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:54.315734 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:54.329826 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 110/215] 10.222.0.39 () {60 vars in 1132 bytes} [Wed May 25 15:02:54 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:02:54.369798 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe9c94-a370-4d21-b519-faca349ceb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:54.370893 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe9c94-a370-4d21-b519-faca349ceb1e None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:54.371386 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe9c94-a370-4d21-b519-faca349ceb1e None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:54.371862 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe9c94-a370-4d21-b519-faca349ceb1e None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:54.372809 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe9c94-a370-4d21-b519-faca349ceb1e None admin] RBAC: Adding query filter params (name=member) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:54.373396 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe9c94-a370-4d21-b519-faca349ceb1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:54.375201 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe9c94-a370-4d21-b519-faca349ceb1e None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:54.386060 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 106/216] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:02:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:54.391603 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031df87-360e-413d-be71-c5aa416ee580 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:54.508800 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031df87-360e-413d-be71-c5aa416ee580 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:54.546889 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13c37b-512f-44c4-897e-fdb434444cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:54.548087 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13c37b-512f-44c4-897e-fdb434444cb0 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:54.548657 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13c37b-512f-44c4-897e-fdb434444cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:54.549107 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13c37b-512f-44c4-897e-fdb434444cb0 None admin] PATH_INFO: `/v3/users/c7b1664174a34965a8c6519b02e7da96` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:54.564112 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13c37b-512f-44c4-897e-fdb434444cb0 None admin] RBAC: Authorizing `identity:get_user(user_id=c7b1664174a34965a8c6519b02e7da96)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:54.565582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13c37b-512f-44c4-897e-fdb434444cb0 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:54.567678 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 111/217] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:54 2022] GET /identity/v3/users/c7b1664174a34965a8c6519b02e7da96 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:54.574289 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe9c94-a370-4d21-b519-faca349ceb1e None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:54.697200 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe9c94-a370-4d21-b519-faca349ceb1e None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:54.733463 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a42c2-e17c-4b5b-bc30-68b5ca4c3a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:54.734130 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a42c2-e17c-4b5b-bc30-68b5ca4c3a93 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:54.734435 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a42c2-e17c-4b5b-bc30-68b5ca4c3a93 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:54.734716 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a42c2-e17c-4b5b-bc30-68b5ca4c3a93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:54.766649 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:54.814116 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a42c2-e17c-4b5b-bc30-68b5ca4c3a93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:54.816473 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a42c2-e17c-4b5b-bc30-68b5ca4c3a93 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:54.926276 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 107/218] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:02:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:02:54.932621 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13c37b-512f-44c4-897e-fdb434444cb0 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:54.961643 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:55.030031 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa2f58-d1ef-41ef-9fe4-84489c742297 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:55.030768 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa2f58-d1ef-41ef-9fe4-84489c742297 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:55.031064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa2f58-d1ef-41ef-9fe4-84489c742297 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:55.032963 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 108/219] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:02:55.039162 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901ffac-a716-4a41-a421-b97ec7199e58 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:55.039613 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901ffac-a716-4a41-a421-b97ec7199e58 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:55.039895 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901ffac-a716-4a41-a421-b97ec7199e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:55.043122 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13c37b-512f-44c4-897e-fdb434444cb0 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:55.062417 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-2901ffac-a716-4a41-a421-b97ec7199e58 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:55.063833 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-2901ffac-a716-4a41-a421-b97ec7199e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:55.129944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96567e44-8cc9-429e-8f06-7757d9d6d317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:55.130905 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96567e44-8cc9-429e-8f06-7757d9d6d317 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:55.131183 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96567e44-8cc9-429e-8f06-7757d9d6d317 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:55.131455 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96567e44-8cc9-429e-8f06-7757d9d6d317 None admin] PATH_INFO: `/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:55.133444 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96567e44-8cc9-429e-8f06-7757d9d6d317 None admin] RBAC: Authorizing `identity:get_project(project_id=5ffc3171df904ff0a47f7fb65d9090cb)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:55.133919 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:55.135991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96567e44-8cc9-429e-8f06-7757d9d6d317 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:55.137725 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 112/220] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:02:54 2022] GET /identity/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:55.147256 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96567e44-8cc9-429e-8f06-7757d9d6d317 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:55.170379 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 109/221] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:02:55.238495 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901ffac-a716-4a41-a421-b97ec7199e58 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:55.307166 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:55.314535 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96567e44-8cc9-429e-8f06-7757d9d6d317 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:55.351619 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb320309-e3d0-4f71-ae89-5ca0da72e6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:55.352522 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb320309-e3d0-4f71-ae89-5ca0da72e6ae None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:55.352978 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb320309-e3d0-4f71-ae89-5ca0da72e6ae None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:55.353387 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb320309-e3d0-4f71-ae89-5ca0da72e6ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:55.354408 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb320309-e3d0-4f71-ae89-5ca0da72e6ae None admin] RBAC: Adding query filter params (role.id=3ddf578e07094ecd820c44387851dbb8, scope.project.id=5ffc3171df904ff0a47f7fb65d9090cb, user.id=c7b1664174a34965a8c6519b02e7da96) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:55.354858 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb320309-e3d0-4f71-ae89-5ca0da72e6ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:55.356444 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb320309-e3d0-4f71-ae89-5ca0da72e6ae None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:55.363012 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 113/222] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:02:55 2022] GET /identity/v3/role_assignments?user.id=c7b1664174a34965a8c6519b02e7da96&scope.project.id=5ffc3171df904ff0a47f7fb65d9090cb&role.id=3ddf578e07094ecd820c44387851dbb8 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:55.440080 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667cd89-ed0b-43fa-bd2a-fe0e62ed5538 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:55.440733 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667cd89-ed0b-43fa-bd2a-fe0e62ed5538 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:55.441225 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667cd89-ed0b-43fa-bd2a-fe0e62ed5538 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:55.442842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 114/223] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:02:55.449172 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1875fd-37ad-4a2a-b5f4-19b643796a8a None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:55.449737 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1875fd-37ad-4a2a-b5f4-19b643796a8a None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:55.450202 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1875fd-37ad-4a2a-b5f4-19b643796a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:55.461470 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901ffac-a716-4a41-a421-b97ec7199e58 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:55.502144 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-5d1875fd-37ad-4a2a-b5f4-19b643796a8a None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:55.502144 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-5d1875fd-37ad-4a2a-b5f4-19b643796a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:55.506653 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccd3c7-7e20-4723-a590-938d70063763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:55.507726 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccd3c7-7e20-4723-a590-938d70063763 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:55.508189 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccd3c7-7e20-4723-a590-938d70063763 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:55.508655 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccd3c7-7e20-4723-a590-938d70063763 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:55.537465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccd3c7-7e20-4723-a590-938d70063763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:55.545956 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-d9ccd3c7-7e20-4723-a590-938d70063763 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:55.545956 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:55.545956 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:55.545956 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:55.545956 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:55.545956 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:55.545956 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:55.545956 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:55.545956 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:55.545956 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:55.545956 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:55.545956 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:55.545956 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:55.545956 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:55.545956 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:55.545956 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:55.546877 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:55.546877 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:55.546877 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:55.546877 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:55.546877 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:55.546877 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:55.546877 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:55.546877 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:55.546877 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:55.546877 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:55.546877 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:55.546877 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:02:55.546877 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:55.546877 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:55.546877 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:55.546877 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:55.547732 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:55.547732 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:55.547732 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:55.547732 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:55.547732 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:55.547732 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:55.547732 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:55.547732 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:55.547732 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:55.547732 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:55.547732 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:02:55.547732 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:02:55.556198 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 110/224] 10.222.0.39 () {56 vars in 1096 bytes} [Wed May 25 15:02:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:02:55.561753 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccd3c7-7e20-4723-a590-938d70063763 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:55.581215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 115/225] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:02:55.606781 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1875fd-37ad-4a2a-b5f4-19b643796a8a None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:55.664453 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:55.753829 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:55.769174 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1875fd-37ad-4a2a-b5f4-19b643796a8a None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:55.780380 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccd3c7-7e20-4723-a590-938d70063763 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:55.833749 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e514b-2010-40ee-a51c-368a7eed1e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:55.834590 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e514b-2010-40ee-a51c-368a7eed1e81 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:55.835481 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e514b-2010-40ee-a51c-368a7eed1e81 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:55.835769 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e514b-2010-40ee-a51c-368a7eed1e81 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:55.844739 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc0a28-26cd-4051-8cb9-6effe2bb3bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:55.845424 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc0a28-26cd-4051-8cb9-6effe2bb3bee None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:55.845767 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc0a28-26cd-4051-8cb9-6effe2bb3bee None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:55.846050 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc0a28-26cd-4051-8cb9-6effe2bb3bee None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:55.846832 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc0a28-26cd-4051-8cb9-6effe2bb3bee None admin] RBAC: Adding query filter params (name=admin) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:55.847142 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc0a28-26cd-4051-8cb9-6effe2bb3bee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:55.848598 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc0a28-26cd-4051-8cb9-6effe2bb3bee None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:55.860230 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e514b-2010-40ee-a51c-368a7eed1e81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:55.868907 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-380e514b-2010-40ee-a51c-368a7eed1e81 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:02:55.868907 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:55.868907 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:55.868907 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:55.868907 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:55.868907 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:55.868907 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:55.868907 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:55.868907 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:55.868907 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:55.868907 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:55.868907 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:55.868907 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:55.868907 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:55.868907 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:55.868907 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:55.869779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:55.869779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:55.869779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:55.869779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:55.869779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:55.869779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:55.869779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:55.869779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:55.869779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:55.869779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:55.869779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:55.869779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:02:55.869779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:55.869779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:55.869779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:55.869779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:55.870582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:55.870582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:55.870582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:55.870582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:55.870582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:55.870582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:55.870582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:55.870582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:55.870582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:55.870582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:55.870582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:02:55.870582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:02:55.870582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 116/226] 10.222.0.39 () {56 vars in 1114 bytes} [Wed May 25 15:02:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:02:55.872172 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 111/227] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:02:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:55.878857 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e514b-2010-40ee-a51c-368a7eed1e81 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:55.879471 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc0a28-26cd-4051-8cb9-6effe2bb3bee None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:55.987084 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e514b-2010-40ee-a51c-368a7eed1e81 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:56.033419 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4512e-108f-4880-acf8-db74be1a9c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:56.034019 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4512e-108f-4880-acf8-db74be1a9c64 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:56.034330 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4512e-108f-4880-acf8-db74be1a9c64 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:56.034609 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4512e-108f-4880-acf8-db74be1a9c64 None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:56.035365 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f4512e-108f-4880-acf8-db74be1a9c64 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:56.035670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f4512e-108f-4880-acf8-db74be1a9c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:56.037068 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f4512e-108f-4880-acf8-db74be1a9c64 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:56.057845 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 117/228] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:02:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:56.066356 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4512e-108f-4880-acf8-db74be1a9c64 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:56.085144 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:56.114409 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc0a28-26cd-4051-8cb9-6effe2bb3bee None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:56.145897 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:56.195536 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef1e4d-0ad5-47cf-8f2c-4691f301f498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:56.196531 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef1e4d-0ad5-47cf-8f2c-4691f301f498 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:56.196839 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef1e4d-0ad5-47cf-8f2c-4691f301f498 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:56.197117 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef1e4d-0ad5-47cf-8f2c-4691f301f498 None admin] PATH_INFO: `/v3/users/8e4f3d4a91534dc3b430fbf3c54b49de` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:56.202997 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef1e4d-0ad5-47cf-8f2c-4691f301f498 None admin] RBAC: Authorizing `identity:get_user(user_id=8e4f3d4a91534dc3b430fbf3c54b49de)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:56.204471 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef1e4d-0ad5-47cf-8f2c-4691f301f498 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:56.205116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4512e-108f-4880-acf8-db74be1a9c64 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:56.206131 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 112/229] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:55 2022] GET /identity/v3/users/8e4f3d4a91534dc3b430fbf3c54b49de => generated 283 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:56.211710 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef1e4d-0ad5-47cf-8f2c-4691f301f498 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:56.245047 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94b388-6eaa-45e1-b508-ab78be9ca82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:56.246793 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94b388-6eaa-45e1-b508-ab78be9ca82e None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:56.247125 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94b388-6eaa-45e1-b508-ab78be9ca82e None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:56.247400 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94b388-6eaa-45e1-b508-ab78be9ca82e None admin] PATH_INFO: `/v3/users/8e4f3d4a91534dc3b430fbf3c54b49de` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:56.250800 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94b388-6eaa-45e1-b508-ab78be9ca82e None admin] RBAC: Authorizing `identity:get_user(user_id=8e4f3d4a91534dc3b430fbf3c54b49de)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:56.252312 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94b388-6eaa-45e1-b508-ab78be9ca82e None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:56.255519 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 118/230] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:56 2022] GET /identity/v3/users/8e4f3d4a91534dc3b430fbf3c54b49de => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:56.260844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94b388-6eaa-45e1-b508-ab78be9ca82e None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:56.397306 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef1e4d-0ad5-47cf-8f2c-4691f301f498 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:56.399900 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:56.438068 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca750f2e-5572-4f99-a785-871f3cbae81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:56.439477 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca750f2e-5572-4f99-a785-871f3cbae81b None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:56.439959 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca750f2e-5572-4f99-a785-871f3cbae81b None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:56.440430 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca750f2e-5572-4f99-a785-871f3cbae81b None admin] PATH_INFO: `/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:56.442449 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca750f2e-5572-4f99-a785-871f3cbae81b None admin] RBAC: Authorizing `identity:get_project(project_id=5ffc3171df904ff0a47f7fb65d9090cb)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:56.444125 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca750f2e-5572-4f99-a785-871f3cbae81b None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:56.446043 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 113/231] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:02:56 2022] GET /identity/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:56.454600 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca750f2e-5572-4f99-a785-871f3cbae81b None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:56.496316 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94b388-6eaa-45e1-b508-ab78be9ca82e None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:56.531736 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:56.566657 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca750f2e-5572-4f99-a785-871f3cbae81b None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:56.604340 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c7ab8-26ea-4728-9a0f-0e71c3199d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:56.605599 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c7ab8-26ea-4728-9a0f-0e71c3199d79 None admin] REQUEST_METHOD: `PUT` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:56.605989 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c7ab8-26ea-4728-9a0f-0e71c3199d79 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:56.606405 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c7ab8-26ea-4728-9a0f-0e71c3199d79 None admin] PATH_INFO: `/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb/users/8e4f3d4a91534dc3b430fbf3c54b49de/roles/ff521c95c8aa454ea3daa6bc36d055b1` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:56.608642 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c7ab8-26ea-4728-9a0f-0e71c3199d79 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ffc3171df904ff0a47f7fb65d9090cb, user_id=8e4f3d4a91534dc3b430fbf3c54b49de, role_id=ff521c95c8aa454ea3daa6bc36d055b1)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:56.610264 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c7ab8-26ea-4728-9a0f-0e71c3199d79 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:56.625161 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 114/232] 10.222.0.39 () {58 vars in 1439 bytes} [Wed May 25 15:02:56 2022] PUT /identity/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb/users/8e4f3d4a91534dc3b430fbf3c54b49de/roles/ff521c95c8aa454ea3daa6bc36d055b1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:02:56.632611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48aac55-a5fd-4129-94d7-785ce4735776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:56.634074 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48aac55-a5fd-4129-94d7-785ce4735776 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:56.634539 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48aac55-a5fd-4129-94d7-785ce4735776 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:56.634817 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48aac55-a5fd-4129-94d7-785ce4735776 None admin] PATH_INFO: `/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:56.639103 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48aac55-a5fd-4129-94d7-785ce4735776 None admin] RBAC: Authorizing `identity:get_project(project_id=5ffc3171df904ff0a47f7fb65d9090cb)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:56.640847 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48aac55-a5fd-4129-94d7-785ce4735776 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:56.643492 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 119/233] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:02:56 2022] GET /identity/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb => generated 302 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:56.650799 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c7ab8-26ea-4728-9a0f-0e71c3199d79 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:56.766122 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c7ab8-26ea-4728-9a0f-0e71c3199d79 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:56.778064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:56.805976 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4d6ad-56bd-4d99-b476-6e9cf65ae9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:56.807470 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4d6ad-56bd-4d99-b476-6e9cf65ae9d8 None admin] REQUEST_METHOD: `PUT` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:56.807930 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4d6ad-56bd-4d99-b476-6e9cf65ae9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:56.808352 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4d6ad-56bd-4d99-b476-6e9cf65ae9d8 None admin] PATH_INFO: `/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb/users/8e4f3d4a91534dc3b430fbf3c54b49de/roles/44e6a84e85f84d5ba38f6ee215622918` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:56.811089 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4d6ad-56bd-4d99-b476-6e9cf65ae9d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ffc3171df904ff0a47f7fb65d9090cb, user_id=8e4f3d4a91534dc3b430fbf3c54b49de, role_id=44e6a84e85f84d5ba38f6ee215622918)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:56.812888 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4d6ad-56bd-4d99-b476-6e9cf65ae9d8 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:56.831527 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 115/234] 10.222.0.39 () {58 vars in 1439 bytes} [Wed May 25 15:02:56 2022] PUT /identity/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb/users/8e4f3d4a91534dc3b430fbf3c54b49de/roles/44e6a84e85f84d5ba38f6ee215622918 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:02:57.286560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bfdaf-f07a-45c1-ada5-f0fa1246e011 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:57.287536 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bfdaf-f07a-45c1-ada5-f0fa1246e011 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:57.288013 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bfdaf-f07a-45c1-ada5-f0fa1246e011 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:57.289713 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 120/235] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:57.295414 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a7090-db79-495c-aad7-f4c5bfbc7e72 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:57.296287 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a7090-db79-495c-aad7-f4c5bfbc7e72 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:57.296766 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a7090-db79-495c-aad7-f4c5bfbc7e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:57.314865 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-603a7090-db79-495c-aad7-f4c5bfbc7e72 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:57.316573 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-603a7090-db79-495c-aad7-f4c5bfbc7e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:57.362150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bdcde-9442-4457-b2f9-2e89a409c967 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:57.362469 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bdcde-9442-4457-b2f9-2e89a409c967 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:57.362752 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bdcde-9442-4457-b2f9-2e89a409c967 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:57.364390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 121/236] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:57.369446 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535761f5-6192-4d79-8ebd-5bf983b59a0b None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:57.369731 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535761f5-6192-4d79-8ebd-5bf983b59a0b None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:57.370324 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535761f5-6192-4d79-8ebd-5bf983b59a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:57.392734 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 116/237] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:57.411339 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-535761f5-6192-4d79-8ebd-5bf983b59a0b None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:57.412559 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-535761f5-6192-4d79-8ebd-5bf983b59a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:57.421967 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a7090-db79-495c-aad7-f4c5bfbc7e72 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:57.541494 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a7090-db79-495c-aad7-f4c5bfbc7e72 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:57.569520 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 122/238] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:57.582471 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:57.586609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7078a-dee3-4bb2-abe3-31935121792f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:57.587503 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7078a-dee3-4bb2-abe3-31935121792f None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:57.587800 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7078a-dee3-4bb2-abe3-31935121792f None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:57.588090 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7078a-dee3-4bb2-abe3-31935121792f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:57.602178 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535761f5-6192-4d79-8ebd-5bf983b59a0b None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:57.611234 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7078a-dee3-4bb2-abe3-31935121792f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:57.622395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-31e7078a-dee3-4bb2-abe3-31935121792f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:02:57.622395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:57.622395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:57.622395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:57.622395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:57.622395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:57.622395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:57.622395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:57.622395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:57.622395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:57.622395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:57.622395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:57.622395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:57.622395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:57.622395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:57.622395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:57.623349 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:57.623349 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:57.623349 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:57.623349 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:57.623349 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:57.623349 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:57.623349 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:57.623349 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:57.623349 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:57.623349 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:57.623349 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:57.623349 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:02:57.623349 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:57.623349 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:57.623349 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:57.623349 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:57.624153 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:57.624153 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:57.624153 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:57.624153 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:57.624153 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:57.624153 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:57.624153 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:57.624153 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:57.624153 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:57.624153 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:57.624153 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:02:57.624153 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:02:57.624822 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 117/239] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:02:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:02:57.631265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7078a-dee3-4bb2-abe3-31935121792f None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:57.724354 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:57.785566 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7078a-dee3-4bb2-abe3-31935121792f None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:57.801202 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535761f5-6192-4d79-8ebd-5bf983b59a0b None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:57.830153 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcadde7-606b-42fe-9c41-5831b32df6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:57.831216 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcadde7-606b-42fe-9c41-5831b32df6fd None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:57.831710 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcadde7-606b-42fe-9c41-5831b32df6fd None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:57.832169 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcadde7-606b-42fe-9c41-5831b32df6fd None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:57.833131 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcadde7-606b-42fe-9c41-5831b32df6fd None admin] RBAC: Adding query filter params (name=reader) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:57.835186 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcadde7-606b-42fe-9c41-5831b32df6fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:57.836942 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcadde7-606b-42fe-9c41-5831b32df6fd None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:57.857923 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 118/240] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:02:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:57.860025 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcadde7-606b-42fe-9c41-5831b32df6fd None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:57.875973 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf7e37-fa9d-4ce9-a751-1dbbde2799a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:57.876793 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf7e37-fa9d-4ce9-a751-1dbbde2799a4 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:57.877071 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf7e37-fa9d-4ce9-a751-1dbbde2799a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:57.877338 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf7e37-fa9d-4ce9-a751-1dbbde2799a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:57.882520 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf7e37-fa9d-4ce9-a751-1dbbde2799a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:57.884046 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf7e37-fa9d-4ce9-a751-1dbbde2799a4 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:57.886205 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 123/241] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:02:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:57.895478 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:57.904745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf7e37-fa9d-4ce9-a751-1dbbde2799a4 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:57.986321 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcadde7-606b-42fe-9c41-5831b32df6fd None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:58.029444 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ab8aa-c361-4521-b44c-56d653176114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:58.030957 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ab8aa-c361-4521-b44c-56d653176114 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:58.032719 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ab8aa-c361-4521-b44c-56d653176114 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:58.033187 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ab8aa-c361-4521-b44c-56d653176114 None admin] PATH_INFO: `/v3/users/03d8c2818b524f51bb829e6bfec48ccc` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:58.063071 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ab8aa-c361-4521-b44c-56d653176114 None admin] RBAC: Authorizing `identity:get_user(user_id=03d8c2818b524f51bb829e6bfec48ccc)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:58.067624 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ab8aa-c361-4521-b44c-56d653176114 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:58.072463 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 119/242] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:57 2022] GET /identity/v3/users/03d8c2818b524f51bb829e6bfec48ccc => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:58.075241 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ab8aa-c361-4521-b44c-56d653176114 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:58.160203 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf7e37-fa9d-4ce9-a751-1dbbde2799a4 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:58.176555 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:58.201179 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80a102-d895-45d3-a670-a3aa51844266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:58.202569 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80a102-d895-45d3-a670-a3aa51844266 None admin] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:58.202991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80a102-d895-45d3-a670-a3aa51844266 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:58.203276 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80a102-d895-45d3-a670-a3aa51844266 None admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:58.204010 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80a102-d895-45d3-a670-a3aa51844266 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:58.204759 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ab8aa-c361-4521-b44c-56d653176114 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:58.205482 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80a102-d895-45d3-a670-a3aa51844266 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:58.233086 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:58.233714 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 124/243] 10.222.0.39 () {60 vars in 1132 bytes} [Wed May 25 15:02:57 2022] POST /identity/v3/users => generated 293 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:02:58.235567 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f6d63-8282-489e-a8d6-3ec742d1efdd None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:58.235902 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f6d63-8282-489e-a8d6-3ec742d1efdd None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:58.236184 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f6d63-8282-489e-a8d6-3ec742d1efdd None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:58.242486 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 125/244] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:58.245812 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def264b-0982-4038-b642-e5d0174f92f8 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:58.246335 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def264b-0982-4038-b642-e5d0174f92f8 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:58.246812 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def264b-0982-4038-b642-e5d0174f92f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:58.251043 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def0d95-bf2f-4212-9222-f740868f55aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:58.251793 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def0d95-bf2f-4212-9222-f740868f55aa None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:58.252452 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def0d95-bf2f-4212-9222-f740868f55aa None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:58.252787 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def0d95-bf2f-4212-9222-f740868f55aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:58.267889 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-2def264b-0982-4038-b642-e5d0174f92f8 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:58.269622 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-2def264b-0982-4038-b642-e5d0174f92f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:58.347979 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def0d95-bf2f-4212-9222-f740868f55aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:58.349588 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def0d95-bf2f-4212-9222-f740868f55aa None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:58.363573 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 126/245] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:58.408346 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def264b-0982-4038-b642-e5d0174f92f8 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:58.527156 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:58.531870 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def264b-0982-4038-b642-e5d0174f92f8 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:58.554989 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 120/246] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:02:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:02:58.560979 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def0d95-bf2f-4212-9222-f740868f55aa None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:58.567475 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:58.573586 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8779a5-5a6e-4afd-81ff-38e322836a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:58.574533 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8779a5-5a6e-4afd-81ff-38e322836a83 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:58.574821 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8779a5-5a6e-4afd-81ff-38e322836a83 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:58.575100 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8779a5-5a6e-4afd-81ff-38e322836a83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:58.586682 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8779a5-5a6e-4afd-81ff-38e322836a83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:02:58.595522 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-7e8779a5-5a6e-4afd-81ff-38e322836a83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:02:58.595522 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:02:58.595522 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:02:58.595522 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:02:58.595522 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:02:58.595522 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:02:58.595522 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:02:58.595522 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:02:58.595522 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:02:58.595522 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:02:58.595522 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:02:58.595522 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:02:58.595522 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:02:58.595522 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:02:58.595522 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:02:58.595522 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:02:58.596577 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:02:58.596577 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:02:58.596577 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:02:58.596577 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:02:58.596577 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:02:58.596577 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:02:58.596577 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:02:58.596577 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:02:58.596577 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:02:58.596577 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:02:58.596577 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:02:58.596577 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:02:58.596577 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:02:58.596577 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:02:58.596577 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:02:58.596577 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:02:58.597440 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:02:58.597440 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:02:58.597440 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:02:58.597440 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:02:58.597440 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:02:58.597440 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:02:58.597440 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:02:58.597440 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:02:58.597440 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:02:58.597440 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:02:58.597440 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:02:58.597440 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:02:58.598077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 127/247] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:02:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:02:58.604951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8779a5-5a6e-4afd-81ff-38e322836a83 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:58.680828 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def0d95-bf2f-4212-9222-f740868f55aa None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:58.729493 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6093f-246b-480e-88ca-b43d14ed139b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:58.730743 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6093f-246b-480e-88ca-b43d14ed139b None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:58.731030 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6093f-246b-480e-88ca-b43d14ed139b None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:58.731304 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6093f-246b-480e-88ca-b43d14ed139b None admin] PATH_INFO: `/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:58.732808 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6093f-246b-480e-88ca-b43d14ed139b None admin] RBAC: Authorizing `identity:get_project(project_id=5ffc3171df904ff0a47f7fb65d9090cb)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:58.734783 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6093f-246b-480e-88ca-b43d14ed139b None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:58.737136 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 121/248] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:02:58 2022] GET /identity/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:58.738132 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8779a5-5a6e-4afd-81ff-38e322836a83 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:58.742925 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6093f-246b-480e-88ca-b43d14ed139b None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:58.781703 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b08f9-456e-4e7f-b8e3-f98768a30fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:58.782533 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b08f9-456e-4e7f-b8e3-f98768a30fb8 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:58.782815 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b08f9-456e-4e7f-b8e3-f98768a30fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:58.783092 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b08f9-456e-4e7f-b8e3-f98768a30fb8 None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:58.783960 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b08f9-456e-4e7f-b8e3-f98768a30fb8 None admin] RBAC: Adding query filter params (name=member) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:58.784272 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b08f9-456e-4e7f-b8e3-f98768a30fb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:58.785682 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b08f9-456e-4e7f-b8e3-f98768a30fb8 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:58.797803 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 128/249] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:02:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:58.803033 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b08f9-456e-4e7f-b8e3-f98768a30fb8 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:58.805260 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:58.874560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:58.881873 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6093f-246b-480e-88ca-b43d14ed139b None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:58.936218 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd2730-bb45-481a-8a40-2f1a2029f503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:58.937226 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd2730-bb45-481a-8a40-2f1a2029f503 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:58.937514 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd2730-bb45-481a-8a40-2f1a2029f503 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:58.938266 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd2730-bb45-481a-8a40-2f1a2029f503 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:58.939183 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd2730-bb45-481a-8a40-2f1a2029f503 None admin] RBAC: Adding query filter params (role.id=79ee931fb56e4180984d7b16ab42999f, scope.project.id=5ffc3171df904ff0a47f7fb65d9090cb, user.id=03d8c2818b524f51bb829e6bfec48ccc) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:02:58.939500 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd2730-bb45-481a-8a40-2f1a2029f503 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:58.941688 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd2730-bb45-481a-8a40-2f1a2029f503 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:58.946291 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b08f9-456e-4e7f-b8e3-f98768a30fb8 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:58.950084 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 122/250] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:02:58 2022] GET /identity/v3/role_assignments?user.id=03d8c2818b524f51bb829e6bfec48ccc&scope.project.id=5ffc3171df904ff0a47f7fb65d9090cb&role.id=79ee931fb56e4180984d7b16ab42999f => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:02:58.996668 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df951332-2ee1-4629-ad3a-5f0033d3e14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:58.997567 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df951332-2ee1-4629-ad3a-5f0033d3e14e None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:58.997856 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df951332-2ee1-4629-ad3a-5f0033d3e14e None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:58.998368 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df951332-2ee1-4629-ad3a-5f0033d3e14e None admin] PATH_INFO: `/v3/users/c7b1664174a34965a8c6519b02e7da96` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:58.999752 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df951332-2ee1-4629-ad3a-5f0033d3e14e None admin] RBAC: Authorizing `identity:get_user(user_id=c7b1664174a34965a8c6519b02e7da96)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:59.001255 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df951332-2ee1-4629-ad3a-5f0033d3e14e None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:59.007670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 129/251] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:02:58 2022] GET /identity/v3/users/c7b1664174a34965a8c6519b02e7da96 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:59.009099 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd2730-bb45-481a-8a40-2f1a2029f503 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:59.127195 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd2730-bb45-481a-8a40-2f1a2029f503 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:59.143095 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:59.166958 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef395d04-6b20-4326-9f74-b81a8c129c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:59.168158 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef395d04-6b20-4326-9f74-b81a8c129c94 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:59.168445 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef395d04-6b20-4326-9f74-b81a8c129c94 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:59.168722 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef395d04-6b20-4326-9f74-b81a8c129c94 None admin] PATH_INFO: `/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:59.169980 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef395d04-6b20-4326-9f74-b81a8c129c94 None admin] RBAC: Authorizing `identity:get_project(project_id=5ffc3171df904ff0a47f7fb65d9090cb)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:59.171668 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef395d04-6b20-4326-9f74-b81a8c129c94 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:59.173471 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 123/252] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:02:59 2022] GET /identity/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:02:59.179927 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df951332-2ee1-4629-ad3a-5f0033d3e14e None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:59.288953 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df951332-2ee1-4629-ad3a-5f0033d3e14e None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:02:59.310341 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:02:59.330071 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1c5e2-bb30-4d88-94bb-1b4eb44614f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:02:59.331003 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1c5e2-bb30-4d88-94bb-1b4eb44614f8 None admin] REQUEST_METHOD: `PUT` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:59.331280 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1c5e2-bb30-4d88-94bb-1b4eb44614f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:59.331548 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1c5e2-bb30-4d88-94bb-1b4eb44614f8 None admin] PATH_INFO: `/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb/users/c7b1664174a34965a8c6519b02e7da96/roles/3ddf578e07094ecd820c44387851dbb8` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:59.338007 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1c5e2-bb30-4d88-94bb-1b4eb44614f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ffc3171df904ff0a47f7fb65d9090cb, user_id=c7b1664174a34965a8c6519b02e7da96, role_id=3ddf578e07094ecd820c44387851dbb8)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:02:59.339836 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1c5e2-bb30-4d88-94bb-1b4eb44614f8 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:02:59.355682 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 130/253] 10.222.0.39 () {58 vars in 1439 bytes} [Wed May 25 15:02:59 2022] PUT /identity/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb/users/c7b1664174a34965a8c6519b02e7da96/roles/3ddf578e07094ecd820c44387851dbb8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:02:59.695106 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8c700-ac8a-4163-b990-5403a81e45fb None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:59.695621 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8c700-ac8a-4163-b990-5403a81e45fb None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:59.695694 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8c700-ac8a-4163-b990-5403a81e45fb None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:59.697159 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 124/254] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:02:59.702940 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c9d26-b482-41d7-a121-1f69aee44df8 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:59.703805 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c9d26-b482-41d7-a121-1f69aee44df8 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:59.704283 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c9d26-b482-41d7-a121-1f69aee44df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:59.726514 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-cb0c9d26-b482-41d7-a121-1f69aee44df8 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:59.728072 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-cb0c9d26-b482-41d7-a121-1f69aee44df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:02:59.819911 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 131/255] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:02:59.846008 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8c700-ac8a-4163-b990-5403a81e45fb None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:02:59.906371 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac5d20-0d37-4cbb-a524-abe5838599a7 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:59.907021 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac5d20-0d37-4cbb-a524-abe5838599a7 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:59.907496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac5d20-0d37-4cbb-a524-abe5838599a7 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:59.909101 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 132/256] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:02:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:02:59.914373 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affa0be-7a0e-4a62-9f22-88ee6d17f8f5 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:02:59.914881 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affa0be-7a0e-4a62-9f22-88ee6d17f8f5 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:02:59.915352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affa0be-7a0e-4a62-9f22-88ee6d17f8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:02:59.945852 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-1affa0be-7a0e-4a62-9f22-88ee6d17f8f5 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:02:59.947645 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-1affa0be-7a0e-4a62-9f22-88ee6d17f8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:00.042340 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8c700-ac8a-4163-b990-5403a81e45fb None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:00.090678 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 133/257] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:03:00.094875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9d56f-c7fb-495a-9b96-93c77ba01aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:00.095777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9d56f-c7fb-495a-9b96-93c77ba01aac None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:00.096131 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9d56f-c7fb-495a-9b96-93c77ba01aac None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:00.096467 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9d56f-c7fb-495a-9b96-93c77ba01aac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:00.107137 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9d56f-c7fb-495a-9b96-93c77ba01aac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:00.115614 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-a6e9d56f-c7fb-495a-9b96-93c77ba01aac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:03:00.115614 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:00.115614 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:00.115614 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:00.115614 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:00.115614 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:00.115614 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:00.115614 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:00.115614 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:00.115614 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:00.115614 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:00.115614 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:00.115614 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:00.115614 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:00.115614 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:00.115614 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:00.116707 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:00.116707 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:00.116707 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:00.116707 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:00.116707 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:00.116707 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:00.116707 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:00.116707 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:00.116707 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:00.116707 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:00.116707 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:00.116707 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:00.116707 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:00.116707 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:00.116707 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:00.116707 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:00.117687 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:00.117687 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:00.117687 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:00.117687 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:00.117687 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:00.117687 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:00.117687 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:00.117687 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:00.117687 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:00.117687 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:00.117687 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:03:00.117687 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:00.126266 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 125/258] 10.222.0.39 () {56 vars in 1114 bytes} [Wed May 25 15:02:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:00.127785 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affa0be-7a0e-4a62-9f22-88ee6d17f8f5 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:00.129393 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9d56f-c7fb-495a-9b96-93c77ba01aac None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:00.203359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:00.236277 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:00.332193 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affa0be-7a0e-4a62-9f22-88ee6d17f8f5 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:00.342124 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9d56f-c7fb-495a-9b96-93c77ba01aac None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:00.384913 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96140fc4-3c7c-4456-a60f-341d3f09d8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:00.385924 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96140fc4-3c7c-4456-a60f-341d3f09d8bf None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:00.386336 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96140fc4-3c7c-4456-a60f-341d3f09d8bf None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:00.386615 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96140fc4-3c7c-4456-a60f-341d3f09d8bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:00.397348 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96140fc4-3c7c-4456-a60f-341d3f09d8bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:00.405712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-96140fc4-3c7c-4456-a60f-341d3f09d8bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:03:00.405712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:00.405712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:00.405712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:00.405712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:00.405712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:00.405712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:00.405712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:00.405712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:00.405712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:00.405712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:00.405712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:00.405712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:00.405712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:00.405712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:00.405712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:00.406612 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:00.406612 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:00.406612 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:00.406612 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:00.406612 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:00.406612 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:00.406612 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:00.406612 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:00.406612 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:00.406612 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:00.406612 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:00.406612 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:00.406612 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:00.406612 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:00.406612 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:00.406612 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:00.407392 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:00.407392 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:00.407392 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:00.407392 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:00.407392 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:00.407392 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:00.407392 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:00.407392 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:00.407392 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:00.407392 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:00.407392 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:03:00.407392 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:00.407392 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 126/259] 10.222.0.39 () {56 vars in 1096 bytes} [Wed May 25 15:03:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:00.414046 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96140fc4-3c7c-4456-a60f-341d3f09d8bf None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:00.425765 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31c9f4-1b27-47af-a4d4-b6f522a7ee6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:00.426556 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31c9f4-1b27-47af-a4d4-b6f522a7ee6a None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:00.426841 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31c9f4-1b27-47af-a4d4-b6f522a7ee6a None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:00.427143 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31c9f4-1b27-47af-a4d4-b6f522a7ee6a None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:00.427902 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b31c9f4-1b27-47af-a4d4-b6f522a7ee6a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:00.428205 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b31c9f4-1b27-47af-a4d4-b6f522a7ee6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:00.429904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b31c9f4-1b27-47af-a4d4-b6f522a7ee6a None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:00.453492 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 134/260] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:03:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:00.457857 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31c9f4-1b27-47af-a4d4-b6f522a7ee6a None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:00.631292 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:00.635270 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96140fc4-3c7c-4456-a60f-341d3f09d8bf None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:00.661132 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31c9f4-1b27-47af-a4d4-b6f522a7ee6a None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:00.664182 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:00.738966 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bf7b1-d022-42fc-8277-2c6913f180ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:00.739913 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19972e-916e-47f2-b7e5-a31a5837ab52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:00.740788 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bf7b1-d022-42fc-8277-2c6913f180ec None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:00.740889 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19972e-916e-47f2-b7e5-a31a5837ab52 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:00.741127 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19972e-916e-47f2-b7e5-a31a5837ab52 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:00.741405 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19972e-916e-47f2-b7e5-a31a5837ab52 None admin] PATH_INFO: `/v3/users/8e4f3d4a91534dc3b430fbf3c54b49de` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:00.741669 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bf7b1-d022-42fc-8277-2c6913f180ec None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:00.742103 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bf7b1-d022-42fc-8277-2c6913f180ec None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:00.743039 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bf7b1-d022-42fc-8277-2c6913f180ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:00.743508 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bf7b1-d022-42fc-8277-2c6913f180ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:00.744732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19972e-916e-47f2-b7e5-a31a5837ab52 None admin] RBAC: Authorizing `identity:get_user(user_id=8e4f3d4a91534dc3b430fbf3c54b49de)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:00.745320 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bf7b1-d022-42fc-8277-2c6913f180ec None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:00.746192 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19972e-916e-47f2-b7e5-a31a5837ab52 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:00.748133 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 135/261] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:03:00 2022] GET /identity/v3/users/8e4f3d4a91534dc3b430fbf3c54b49de => generated 283 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:00.753434 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19972e-916e-47f2-b7e5-a31a5837ab52 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:00.756182 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 127/262] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:00.761697 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bf7b1-d022-42fc-8277-2c6913f180ec None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:00.864543 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bf7b1-d022-42fc-8277-2c6913f180ec None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:00.905818 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4b704-cf08-4733-a8aa-609363e87280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:00.907260 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4b704-cf08-4733-a8aa-609363e87280 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:00.907714 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4b704-cf08-4733-a8aa-609363e87280 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:00.908337 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4b704-cf08-4733-a8aa-609363e87280 None admin] PATH_INFO: `/v3/users/8e4f3d4a91534dc3b430fbf3c54b49de` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:00.910202 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4b704-cf08-4733-a8aa-609363e87280 None admin] RBAC: Authorizing `identity:get_user(user_id=8e4f3d4a91534dc3b430fbf3c54b49de)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:00.911885 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4b704-cf08-4733-a8aa-609363e87280 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:00.913726 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 128/263] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:03:00 2022] GET /identity/v3/users/8e4f3d4a91534dc3b430fbf3c54b49de => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:00.920021 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4b704-cf08-4733-a8aa-609363e87280 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:00.944528 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19972e-916e-47f2-b7e5-a31a5837ab52 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:00.960092 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:01.018092 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f235d2-0339-490e-8fdb-1f0eb4a0858c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:01.018718 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f235d2-0339-490e-8fdb-1f0eb4a0858c None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:01.019049 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f235d2-0339-490e-8fdb-1f0eb4a0858c None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:01.019327 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f235d2-0339-490e-8fdb-1f0eb4a0858c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:01.030313 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4b704-cf08-4733-a8aa-609363e87280 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:01.065136 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c1497-0f45-4b7f-a8d0-8c8b218b93ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:01.066089 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c1497-0f45-4b7f-a8d0-8c8b218b93ea None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:01.066664 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c1497-0f45-4b7f-a8d0-8c8b218b93ea None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:01.067110 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c1497-0f45-4b7f-a8d0-8c8b218b93ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:01.089685 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:01.129898 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f235d2-0339-490e-8fdb-1f0eb4a0858c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:01.135846 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f235d2-0339-490e-8fdb-1f0eb4a0858c None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:01.137072 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c1497-0f45-4b7f-a8d0-8c8b218b93ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:01.138750 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c1497-0f45-4b7f-a8d0-8c8b218b93ea None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:01.173921 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:01.241333 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 129/264] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:03:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 15:03:01.247105 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c1497-0f45-4b7f-a8d0-8c8b218b93ea None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:01.330595 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 136/265] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:03:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 15:03:01.335842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f235d2-0339-490e-8fdb-1f0eb4a0858c None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:01.347675 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c1497-0f45-4b7f-a8d0-8c8b218b93ea None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:01.378056 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:01.384891 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f28b8-005e-423b-9655-26e6fb119dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:01.386005 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f28b8-005e-423b-9655-26e6fb119dde None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:01.386484 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f28b8-005e-423b-9655-26e6fb119dde None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:01.386926 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f28b8-005e-423b-9655-26e6fb119dde None admin] PATH_INFO: `/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:01.388299 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f28b8-005e-423b-9655-26e6fb119dde None admin] RBAC: Authorizing `identity:get_project(project_id=5ffc3171df904ff0a47f7fb65d9090cb)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:01.390376 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f28b8-005e-423b-9655-26e6fb119dde None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:01.392310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 130/266] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:03:01 2022] GET /identity/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:01.398408 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f28b8-005e-423b-9655-26e6fb119dde None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:01.426577 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:01.468039 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f235d2-0339-490e-8fdb-1f0eb4a0858c None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:01.507950 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a41c6a-d5c6-4b4c-9226-b4d9d943aedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:01.510388 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a41c6a-d5c6-4b4c-9226-b4d9d943aedb None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:01.511042 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a41c6a-d5c6-4b4c-9226-b4d9d943aedb None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:01.512066 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a41c6a-d5c6-4b4c-9226-b4d9d943aedb None admin] PATH_INFO: `/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:01.517787 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a41c6a-d5c6-4b4c-9226-b4d9d943aedb None admin] RBAC: Authorizing `identity:get_project(project_id=5ffc3171df904ff0a47f7fb65d9090cb)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:01.519789 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a41c6a-d5c6-4b4c-9226-b4d9d943aedb None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:01.523043 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 137/267] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:03:01 2022] GET /identity/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:01.531829 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a41c6a-d5c6-4b4c-9226-b4d9d943aedb None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:01.632388 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f28b8-005e-423b-9655-26e6fb119dde None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:01.696803 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a41c6a-d5c6-4b4c-9226-b4d9d943aedb None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:01.741374 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce44b30-8065-4f0a-9931-d36158478faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:01.742049 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce44b30-8065-4f0a-9931-d36158478faf None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:01.742372 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce44b30-8065-4f0a-9931-d36158478faf None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:01.742655 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce44b30-8065-4f0a-9931-d36158478faf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:01.743502 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce44b30-8065-4f0a-9931-d36158478faf None admin] RBAC: Adding query filter params (role.id=ff521c95c8aa454ea3daa6bc36d055b1, scope.project.id=5ffc3171df904ff0a47f7fb65d9090cb, user.id=8e4f3d4a91534dc3b430fbf3c54b49de) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:01.743827 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce44b30-8065-4f0a-9931-d36158478faf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:01.745291 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce44b30-8065-4f0a-9931-d36158478faf None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:01.758330 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf0285-6445-44bd-a5c5-5d168924ceaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:01.758855 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 131/268] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:03:01 2022] GET /identity/v3/role_assignments?user.id=8e4f3d4a91534dc3b430fbf3c54b49de&scope.project.id=5ffc3171df904ff0a47f7fb65d9090cb&role.id=ff521c95c8aa454ea3daa6bc36d055b1 => generated 608 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:01.759077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf0285-6445-44bd-a5c5-5d168924ceaa None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:01.759367 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf0285-6445-44bd-a5c5-5d168924ceaa None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:01.759706 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf0285-6445-44bd-a5c5-5d168924ceaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:01.760548 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf0285-6445-44bd-a5c5-5d168924ceaa None admin] RBAC: Adding query filter params (role.id=44e6a84e85f84d5ba38f6ee215622918, scope.project.id=5ffc3171df904ff0a47f7fb65d9090cb, user.id=8e4f3d4a91534dc3b430fbf3c54b49de) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:01.760998 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf0285-6445-44bd-a5c5-5d168924ceaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:01.762495 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf0285-6445-44bd-a5c5-5d168924ceaa None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:01.774190 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 138/269] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:03:01 2022] GET /identity/v3/role_assignments?user.id=8e4f3d4a91534dc3b430fbf3c54b49de&scope.project.id=5ffc3171df904ff0a47f7fb65d9090cb&role.id=44e6a84e85f84d5ba38f6ee215622918 => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:02.187265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f601fc9-cb17-4a0d-9a5d-db74d669c8e1 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:02.187630 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f601fc9-cb17-4a0d-9a5d-db74d669c8e1 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:02.187842 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f601fc9-cb17-4a0d-9a5d-db74d669c8e1 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:02.189523 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 132/270] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:02.195104 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a13682-7a94-4d6c-a439-6c93ffd9bfb3 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:02.195399 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a13682-7a94-4d6c-a439-6c93ffd9bfb3 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:02.195683 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a13682-7a94-4d6c-a439-6c93ffd9bfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:02.200862 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:02.215324 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-92a13682-7a94-4d6c-a439-6c93ffd9bfb3 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:02.216533 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-92a13682-7a94-4d6c-a439-6c93ffd9bfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:02.282765 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499e44e-fc9b-4ef2-8437-7bcb81bc26f4 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:02.283558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499e44e-fc9b-4ef2-8437-7bcb81bc26f4 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:02.284215 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499e44e-fc9b-4ef2-8437-7bcb81bc26f4 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:02.285781 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 133/271] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:03:02.291866 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 139/272] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:02.293016 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a56669-2975-4335-a0bc-322a199ded41 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:02.293442 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a56669-2975-4335-a0bc-322a199ded41 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:02.293850 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a56669-2975-4335-a0bc-322a199ded41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:02.321844 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-18a56669-2975-4335-a0bc-322a199ded41 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:02.323099 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-18a56669-2975-4335-a0bc-322a199ded41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:02.324426 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a13682-7a94-4d6c-a439-6c93ffd9bfb3 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:02.392610 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:02.404564 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 134/273] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:03:02.443970 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a56669-2975-4335-a0bc-322a199ded41 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:02.453147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a13682-7a94-4d6c-a439-6c93ffd9bfb3 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:02.486659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:02.492321 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb507d-abb0-460b-b939-29d9fcdfed0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:02.493188 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb507d-abb0-460b-b939-29d9fcdfed0f None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:02.493519 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb507d-abb0-460b-b939-29d9fcdfed0f None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:02.493800 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb507d-abb0-460b-b939-29d9fcdfed0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:02.495181 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb507d-abb0-460b-b939-29d9fcdfed0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:02.496657 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb507d-abb0-460b-b939-29d9fcdfed0f None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:02.498992 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 140/274] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:02.504761 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb507d-abb0-460b-b939-29d9fcdfed0f None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:02.581878 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a56669-2975-4335-a0bc-322a199ded41 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:02.630052 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a445db-87e5-4a88-ae19-4f0ae966a97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:02.630920 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a445db-87e5-4a88-ae19-4f0ae966a97a None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:02.631203 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a445db-87e5-4a88-ae19-4f0ae966a97a None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:02.631477 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a445db-87e5-4a88-ae19-4f0ae966a97a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:02.643217 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb507d-abb0-460b-b939-29d9fcdfed0f None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:02.643449 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a445db-87e5-4a88-ae19-4f0ae966a97a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:02.651728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-54a445db-87e5-4a88-ae19-4f0ae966a97a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:03:02.651728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:02.651728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:02.651728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:02.651728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:02.651728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:02.651728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:02.651728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:02.651728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:02.651728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:02.651728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:02.651728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:02.651728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:02.651728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:02.651728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:02.651728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:02.653138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:02.653138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:02.653138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:02.653138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:02.653138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:02.653138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:02.653138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:02.653138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:02.653138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:02.653138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:02.653138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:02.653138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:02.653138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:02.653138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:02.653138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:02.653138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:02.654470 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:02.654470 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:02.654470 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:02.654470 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:02.654470 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:02.654470 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:02.654470 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:02.654470 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:02.654470 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:02.654470 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:02.654470 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:03:02.654470 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:02.658266 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 135/275] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:02.659360 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a445db-87e5-4a88-ae19-4f0ae966a97a None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:02.683236 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49baf135-6624-4d99-afae-affa5807d177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:02.684183 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baf135-6624-4d99-afae-affa5807d177 None admin] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:02.684467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baf135-6624-4d99-afae-affa5807d177 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:02.684738 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baf135-6624-4d99-afae-affa5807d177 None admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:02.685718 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49baf135-6624-4d99-afae-affa5807d177 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:02.689009 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49baf135-6624-4d99-afae-affa5807d177 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:02.719072 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:02.723642 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 141/276] 10.222.0.39 () {60 vars in 1132 bytes} [Wed May 25 15:03:02 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:03:02.732573 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc7d18-4951-4595-8ca6-a7e966455e1f None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:02.732938 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc7d18-4951-4595-8ca6-a7e966455e1f None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:02.733230 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc7d18-4951-4595-8ca6-a7e966455e1f None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:02.739445 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 142/277] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:02.742448 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27edaff-2bc9-4835-a28c-66f43eb1c539 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:02.742743 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27edaff-2bc9-4835-a28c-66f43eb1c539 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:02.743004 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27edaff-2bc9-4835-a28c-66f43eb1c539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:02.766431 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-c27edaff-2bc9-4835-a28c-66f43eb1c539 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:02.767830 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-c27edaff-2bc9-4835-a28c-66f43eb1c539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:02.788384 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a445db-87e5-4a88-ae19-4f0ae966a97a None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:02.830224 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706e0c1-001b-44f6-ba33-0fb946bfecf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:02.831453 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706e0c1-001b-44f6-ba33-0fb946bfecf0 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:02.831934 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706e0c1-001b-44f6-ba33-0fb946bfecf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:02.832435 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706e0c1-001b-44f6-ba33-0fb946bfecf0 None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:02.833410 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706e0c1-001b-44f6-ba33-0fb946bfecf0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:02.833927 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706e0c1-001b-44f6-ba33-0fb946bfecf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:02.835655 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4706e0c1-001b-44f6-ba33-0fb946bfecf0 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:02.840048 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:02.845815 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 136/278] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:03:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:02.847090 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc199a7b-9334-401a-8820-952b1fef423d None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:02.847422 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc199a7b-9334-401a-8820-952b1fef423d None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:02.847708 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc199a7b-9334-401a-8820-952b1fef423d None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:02.849185 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 137/279] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:02.854792 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67f790-6e02-44d3-b1fc-27ee4cfd2a41 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:02.854958 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67f790-6e02-44d3-b1fc-27ee4cfd2a41 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:02.855231 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67f790-6e02-44d3-b1fc-27ee4cfd2a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:02.867883 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 143/280] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:02.868889 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27edaff-2bc9-4835-a28c-66f43eb1c539 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:02.883648 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-ff67f790-6e02-44d3-b1fc-27ee4cfd2a41 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:02.885550 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-ff67f790-6e02-44d3-b1fc-27ee4cfd2a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:02.965792 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 138/281] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:02.966216 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67f790-6e02-44d3-b1fc-27ee4cfd2a41 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:02.987748 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27edaff-2bc9-4835-a28c-66f43eb1c539 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:03.025975 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:03.038368 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392d35f-000e-419f-a87d-21a57b3787f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:03.039269 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392d35f-000e-419f-a87d-21a57b3787f0 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:03.039548 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392d35f-000e-419f-a87d-21a57b3787f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:03.039817 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392d35f-000e-419f-a87d-21a57b3787f0 None admin] PATH_INFO: `/v3/users/03d8c2818b524f51bb829e6bfec48ccc` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:03.041779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392d35f-000e-419f-a87d-21a57b3787f0 None admin] RBAC: Authorizing `identity:get_user(user_id=03d8c2818b524f51bb829e6bfec48ccc)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:03.043251 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392d35f-000e-419f-a87d-21a57b3787f0 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:03.045043 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 144/282] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:03:02 2022] GET /identity/v3/users/03d8c2818b524f51bb829e6bfec48ccc => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:03.045855 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392d35f-000e-419f-a87d-21a57b3787f0 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:03.091228 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67f790-6e02-44d3-b1fc-27ee4cfd2a41 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:03.115062 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:03.132866 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbb32a-8ba9-463b-9fd3-d798c403952b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:03.133973 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbb32a-8ba9-463b-9fd3-d798c403952b None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:03.133973 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbb32a-8ba9-463b-9fd3-d798c403952b None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:03.133973 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbb32a-8ba9-463b-9fd3-d798c403952b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:03.150134 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbb32a-8ba9-463b-9fd3-d798c403952b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:03.160622 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-60dbb32a-8ba9-463b-9fd3-d798c403952b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:03:03.160622 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:03.160622 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:03.160622 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:03.160622 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:03.160622 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:03.160622 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:03.160622 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:03.160622 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:03.160622 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:03.160622 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:03.160622 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:03.160622 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:03.160622 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:03.160622 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:03.160622 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:03.161530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:03.161530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:03.161530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:03.161530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:03.161530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:03.161530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:03.161530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:03.161530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:03.161530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:03.161530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:03.161530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:03.161530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:03.161530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:03.161530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:03.161530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:03.161530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:03.162935 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:03.162935 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:03.162935 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:03.162935 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:03.162935 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:03.162935 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:03.162935 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:03.162935 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:03.162935 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:03.162935 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:03.162935 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:03:03.162935 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:03.162935 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 139/283] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:03.163838 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbb32a-8ba9-463b-9fd3-d798c403952b None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:03.169985 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392d35f-000e-419f-a87d-21a57b3787f0 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:03.215559 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7886a-9732-47e5-a465-74eec3f56e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:03.216423 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7886a-9732-47e5-a465-74eec3f56e14 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:03.216853 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7886a-9732-47e5-a465-74eec3f56e14 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:03.217130 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7886a-9732-47e5-a465-74eec3f56e14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:03.231922 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7886a-9732-47e5-a465-74eec3f56e14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:03.242084 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-dac7886a-9732-47e5-a465-74eec3f56e14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:03:03.242084 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:03.242084 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:03.242084 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:03.242084 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:03.242084 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:03.242084 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:03.242084 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:03.242084 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:03.242084 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:03.242084 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:03.242084 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:03.242084 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:03.242084 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:03.242084 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:03.242084 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:03.243030 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:03.243030 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:03.243030 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:03.243030 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:03.243030 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:03.243030 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:03.243030 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:03.243030 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:03.243030 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:03.243030 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:03.243030 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:03.243030 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:03.243030 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:03.243030 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:03.243030 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:03.243030 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:03.244215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:03.244215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:03.244215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:03.244215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:03.244215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:03.244215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:03.244215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:03.244215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:03.244215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:03.244215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:03.244215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:03:03.244215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:03.244215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 145/284] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:03.244215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7886a-9732-47e5-a465-74eec3f56e14 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:03.274473 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbb32a-8ba9-463b-9fd3-d798c403952b None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:03.287737 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:03.321037 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e86612-d698-4fc1-8680-748841dc791c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:03.322514 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e86612-d698-4fc1-8680-748841dc791c None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:03.322814 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e86612-d698-4fc1-8680-748841dc791c None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:03.323097 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e86612-d698-4fc1-8680-748841dc791c None admin] PATH_INFO: `/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:03.324786 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e86612-d698-4fc1-8680-748841dc791c None admin] RBAC: Authorizing `identity:get_project(project_id=5ffc3171df904ff0a47f7fb65d9090cb)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:03.326588 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e86612-d698-4fc1-8680-748841dc791c None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:03.329486 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 140/285] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:03:03 2022] GET /identity/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:03.330413 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e86612-d698-4fc1-8680-748841dc791c None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:03.375795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7886a-9732-47e5-a465-74eec3f56e14 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:03.395062 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:03.425307 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f7f20-735f-4a69-a2a1-f8fe5d72ec4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:03.426569 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f7f20-735f-4a69-a2a1-f8fe5d72ec4e None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:03.426861 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f7f20-735f-4a69-a2a1-f8fe5d72ec4e None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:03.427136 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f7f20-735f-4a69-a2a1-f8fe5d72ec4e None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:03.427899 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f7f20-735f-4a69-a2a1-f8fe5d72ec4e None admin] RBAC: Adding query filter params (name=member) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:03.428204 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f7f20-735f-4a69-a2a1-f8fe5d72ec4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:03.429892 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f7f20-735f-4a69-a2a1-f8fe5d72ec4e None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:03.439180 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 146/286] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:03:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:03.439900 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f7f20-735f-4a69-a2a1-f8fe5d72ec4e None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:03.461571 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e86612-d698-4fc1-8680-748841dc791c None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:03.510311 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5514480-78c6-4174-b469-c8d4f61aa677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:03.511610 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5514480-78c6-4174-b469-c8d4f61aa677 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:03.512505 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5514480-78c6-4174-b469-c8d4f61aa677 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:03.513246 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5514480-78c6-4174-b469-c8d4f61aa677 None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:03.514215 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5514480-78c6-4174-b469-c8d4f61aa677 None admin] RBAC: Adding query filter params (name=member) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:03.514815 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5514480-78c6-4174-b469-c8d4f61aa677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:03.517295 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5514480-78c6-4174-b469-c8d4f61aa677 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:03.530681 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 141/287] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:03:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:03.537493 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5514480-78c6-4174-b469-c8d4f61aa677 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:03.562279 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f7f20-735f-4a69-a2a1-f8fe5d72ec4e None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:03.585609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:03.600153 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb9709-d776-48ca-8c0e-1f654d5771b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:03.600963 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb9709-d776-48ca-8c0e-1f654d5771b3 None admin] REQUEST_METHOD: `PUT` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:03.601245 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb9709-d776-48ca-8c0e-1f654d5771b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:03.601523 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb9709-d776-48ca-8c0e-1f654d5771b3 None admin] PATH_INFO: `/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb/users/03d8c2818b524f51bb829e6bfec48ccc/roles/79ee931fb56e4180984d7b16ab42999f` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:03.603499 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb9709-d776-48ca-8c0e-1f654d5771b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ffc3171df904ff0a47f7fb65d9090cb, user_id=03d8c2818b524f51bb829e6bfec48ccc, role_id=79ee931fb56e4180984d7b16ab42999f)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:03.605004 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb9709-d776-48ca-8c0e-1f654d5771b3 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:03.623956 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 147/288] 10.222.0.39 () {58 vars in 1439 bytes} [Wed May 25 15:03:03 2022] PUT /identity/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb/users/03d8c2818b524f51bb829e6bfec48ccc/roles/79ee931fb56e4180984d7b16ab42999f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:03.625790 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb9709-d776-48ca-8c0e-1f654d5771b3 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:03.679390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:03.683278 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5514480-78c6-4174-b469-c8d4f61aa677 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:03.735254 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f438e55-e7a1-4441-91da-aa4efa6bf8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:03.737127 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f438e55-e7a1-4441-91da-aa4efa6bf8c6 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:03.737674 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f438e55-e7a1-4441-91da-aa4efa6bf8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:03.738149 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f438e55-e7a1-4441-91da-aa4efa6bf8c6 None admin] PATH_INFO: `/v3/users/9cb2bec062a14a2ab1de3242be4dcc7b` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:03.767083 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f438e55-e7a1-4441-91da-aa4efa6bf8c6 None admin] RBAC: Authorizing `identity:get_user(user_id=9cb2bec062a14a2ab1de3242be4dcc7b)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:03.769470 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f438e55-e7a1-4441-91da-aa4efa6bf8c6 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:03.772133 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 142/289] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:03:03 2022] GET /identity/v3/users/9cb2bec062a14a2ab1de3242be4dcc7b => generated 293 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:03.777875 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb9709-d776-48ca-8c0e-1f654d5771b3 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:03.780619 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f438e55-e7a1-4441-91da-aa4efa6bf8c6 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:03.862559 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2ec58-a8cc-419d-826b-8553836eb481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:03.863464 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2ec58-a8cc-419d-826b-8553836eb481 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:03.863746 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2ec58-a8cc-419d-826b-8553836eb481 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:03.864082 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2ec58-a8cc-419d-826b-8553836eb481 None admin] PATH_INFO: `/v3/users/c7b1664174a34965a8c6519b02e7da96` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:03.865521 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2ec58-a8cc-419d-826b-8553836eb481 None admin] RBAC: Authorizing `identity:get_user(user_id=c7b1664174a34965a8c6519b02e7da96)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:03.867024 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2ec58-a8cc-419d-826b-8553836eb481 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:03.868696 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 148/290] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:03:03 2022] GET /identity/v3/users/c7b1664174a34965a8c6519b02e7da96 => generated 297 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:03.875274 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2ec58-a8cc-419d-826b-8553836eb481 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:03.932744 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:03.946173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f438e55-e7a1-4441-91da-aa4efa6bf8c6 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:03.991464 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf5ca8-4183-4886-9deb-cbe8f9ee7fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:03.992235 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf5ca8-4183-4886-9deb-cbe8f9ee7fb6 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:03.992589 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf5ca8-4183-4886-9deb-cbe8f9ee7fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:03.993016 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf5ca8-4183-4886-9deb-cbe8f9ee7fb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:03.994064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf5ca8-4183-4886-9deb-cbe8f9ee7fb6 None admin] RBAC: Adding query filter params (role.id=3ddf578e07094ecd820c44387851dbb8, user.id=9cb2bec062a14a2ab1de3242be4dcc7b, scope.system=all) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:03.994559 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf5ca8-4183-4886-9deb-cbe8f9ee7fb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:03.996061 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf5ca8-4183-4886-9deb-cbe8f9ee7fb6 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:04.001673 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 143/291] 10.222.0.39 () {56 vars in 1308 bytes} [Wed May 25 15:03:03 2022] GET /identity/v3/role_assignments?user.id=9cb2bec062a14a2ab1de3242be4dcc7b&scope.system=all&role.id=3ddf578e07094ecd820c44387851dbb8 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:04.012118 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2ec58-a8cc-419d-826b-8553836eb481 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:04.015525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:04.055816 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcce167-463d-4310-8cf4-0188a0b025bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:04.056726 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcce167-463d-4310-8cf4-0188a0b025bf None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:04.057153 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcce167-463d-4310-8cf4-0188a0b025bf None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:04.057591 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcce167-463d-4310-8cf4-0188a0b025bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:04.136090 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcce167-463d-4310-8cf4-0188a0b025bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:04.137845 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcce167-463d-4310-8cf4-0188a0b025bf None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:04.254473 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 149/292] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:03:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:03:04.256517 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf5ca8-4183-4886-9deb-cbe8f9ee7fb6 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:04.398603 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf5ca8-4183-4886-9deb-cbe8f9ee7fb6 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:04.436517 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de611f-bf55-4ef3-9e1f-733d0c9c3e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:04.437647 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de611f-bf55-4ef3-9e1f-733d0c9c3e55 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:04.438072 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de611f-bf55-4ef3-9e1f-733d0c9c3e55 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:04.438518 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de611f-bf55-4ef3-9e1f-733d0c9c3e55 None admin] PATH_INFO: `/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:04.439894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de611f-bf55-4ef3-9e1f-733d0c9c3e55 None admin] RBAC: Authorizing `identity:get_project(project_id=5ffc3171df904ff0a47f7fb65d9090cb)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:04.441671 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de611f-bf55-4ef3-9e1f-733d0c9c3e55 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:04.444960 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 144/293] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:03:04 2022] GET /identity/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:04.450904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcce167-463d-4310-8cf4-0188a0b025bf None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:04.456798 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:04.562525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcce167-463d-4310-8cf4-0188a0b025bf None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:04.598025 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e87ea-c6aa-4074-9afa-a38463644c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:04.598974 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e87ea-c6aa-4074-9afa-a38463644c79 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:04.599465 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e87ea-c6aa-4074-9afa-a38463644c79 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:04.599869 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e87ea-c6aa-4074-9afa-a38463644c79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:04.600900 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e87ea-c6aa-4074-9afa-a38463644c79 None admin] RBAC: Adding query filter params (role.id=3ddf578e07094ecd820c44387851dbb8, scope.project.id=5ffc3171df904ff0a47f7fb65d9090cb, user.id=c7b1664174a34965a8c6519b02e7da96) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:04.601468 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e87ea-c6aa-4074-9afa-a38463644c79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:04.603890 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e87ea-c6aa-4074-9afa-a38463644c79 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:04.611071 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 150/294] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:03:04 2022] GET /identity/v3/role_assignments?user.id=c7b1664174a34965a8c6519b02e7da96&scope.project.id=5ffc3171df904ff0a47f7fb65d9090cb&role.id=3ddf578e07094ecd820c44387851dbb8 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:05.436742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb271ed7-8e35-4035-8ae3-480d2150e4ef None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:05.437301 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb271ed7-8e35-4035-8ae3-480d2150e4ef None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:05.437379 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb271ed7-8e35-4035-8ae3-480d2150e4ef None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:05.438783 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 145/295] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:05.443884 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3b0d5-9f25-4a4a-96d5-6a1892631c29 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:05.444277 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3b0d5-9f25-4a4a-96d5-6a1892631c29 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:05.444433 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3b0d5-9f25-4a4a-96d5-6a1892631c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:05.461512 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-a0b3b0d5-9f25-4a4a-96d5-6a1892631c29 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:05.462710 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-a0b3b0d5-9f25-4a4a-96d5-6a1892631c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:05.470196 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10578c7-6a1f-4c78-8708-dd465d5d022e None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:05.470897 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10578c7-6a1f-4c78-8708-dd465d5d022e None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:05.471468 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10578c7-6a1f-4c78-8708-dd465d5d022e None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:05.473615 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 146/296] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:03:05.480601 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6008f-c0b1-4120-a9cf-5097e44f5f12 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:05.481381 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6008f-c0b1-4120-a9cf-5097e44f5f12 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:05.481884 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6008f-c0b1-4120-a9cf-5097e44f5f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:05.504025 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-e2a6008f-c0b1-4120-a9cf-5097e44f5f12 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:05.505731 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-e2a6008f-c0b1-4120-a9cf-5097e44f5f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:05.531854 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:05.538713 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:05.550548 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 151/297] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:05.571059 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3b0d5-9f25-4a4a-96d5-6a1892631c29 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:05.607498 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 147/298] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:03:05.634318 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6008f-c0b1-4120-a9cf-5097e44f5f12 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:05.690742 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3b0d5-9f25-4a4a-96d5-6a1892631c29 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:05.728464 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38eb52-b5c8-4d5f-a510-1bb8ed02a53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:05.729280 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38eb52-b5c8-4d5f-a510-1bb8ed02a53c None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:05.729565 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38eb52-b5c8-4d5f-a510-1bb8ed02a53c None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:05.729842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38eb52-b5c8-4d5f-a510-1bb8ed02a53c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:05.731025 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38eb52-b5c8-4d5f-a510-1bb8ed02a53c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:05.732600 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38eb52-b5c8-4d5f-a510-1bb8ed02a53c None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:05.737254 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 152/299] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:05.742718 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38eb52-b5c8-4d5f-a510-1bb8ed02a53c None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:05.766850 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6008f-c0b1-4120-a9cf-5097e44f5f12 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:05.813627 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a8b4b-5b2c-45fb-b60f-f2ffe29af52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:05.814489 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a8b4b-5b2c-45fb-b60f-f2ffe29af52b None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:05.814774 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a8b4b-5b2c-45fb-b60f-f2ffe29af52b None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:05.815050 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a8b4b-5b2c-45fb-b60f-f2ffe29af52b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:05.829519 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a8b4b-5b2c-45fb-b60f-f2ffe29af52b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:05.832078 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:05.839858 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-d91a8b4b-5b2c-45fb-b60f-f2ffe29af52b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:03:05.839858 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:05.839858 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:05.839858 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:05.839858 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:05.839858 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:05.839858 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:05.839858 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:05.839858 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:05.839858 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:05.839858 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:05.839858 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:05.839858 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:05.839858 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:05.839858 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:05.839858 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:05.840791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:05.840791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:05.840791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:05.840791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:05.840791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:05.840791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:05.840791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:05.840791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:05.840791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:05.840791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:05.840791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:05.840791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:05.840791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:05.840791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:05.840791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:05.840791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:05.841563 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:05.841563 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:05.841563 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:05.841563 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:05.841563 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:05.841563 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:05.841563 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:05.841563 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:05.841563 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:05.841563 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:05.841563 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:03:05.841563 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:05.841563 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 148/300] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:03:05.847538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a8b4b-5b2c-45fb-b60f-f2ffe29af52b None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:05.868276 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:05.887732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38eb52-b5c8-4d5f-a510-1bb8ed02a53c None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:05.934519 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a7437-5201-435e-bb43-5b93be95f7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:05.936110 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a7437-5201-435e-bb43-5b93be95f7b5 None admin] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:05.936928 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a7437-5201-435e-bb43-5b93be95f7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:05.937529 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a7437-5201-435e-bb43-5b93be95f7b5 None admin] PATH_INFO: `/v3/groups` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:05.938708 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a7437-5201-435e-bb43-5b93be95f7b5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:05.941697 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a7437-5201-435e-bb43-5b93be95f7b5 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:05.965468 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 153/301] 10.222.0.39 () {60 vars in 1134 bytes} [Wed May 25 15:03:05 2022] POST /identity/v3/groups => generated 229 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:05.977336 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a8b4b-5b2c-45fb-b60f-f2ffe29af52b None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:06.019828 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474abdd-f5c6-4958-9d40-512c0f9365e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:06.020901 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474abdd-f5c6-4958-9d40-512c0f9365e3 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:06.021386 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474abdd-f5c6-4958-9d40-512c0f9365e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:06.021894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474abdd-f5c6-4958-9d40-512c0f9365e3 None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:06.022931 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474abdd-f5c6-4958-9d40-512c0f9365e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:06.023491 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474abdd-f5c6-4958-9d40-512c0f9365e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:06.025188 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474abdd-f5c6-4958-9d40-512c0f9365e3 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:06.037984 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 149/302] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:03:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:06.043623 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a7437-5201-435e-bb43-5b93be95f7b5 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:06.168708 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a7437-5201-435e-bb43-5b93be95f7b5 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:06.198689 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:06.212687 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab4406-4b8c-4f9b-9ab2-1695af73555f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:06.213034 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab4406-4b8c-4f9b-9ab2-1695af73555f None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:06.213315 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab4406-4b8c-4f9b-9ab2-1695af73555f None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:06.213589 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab4406-4b8c-4f9b-9ab2-1695af73555f None admin] PATH_INFO: `/v3/users/06a5ce75a5454e258837036f69e5daa1` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:06.231999 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab4406-4b8c-4f9b-9ab2-1695af73555f None admin] RBAC: Authorizing `identity:get_user(user_id=06a5ce75a5454e258837036f69e5daa1)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:06.233796 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab4406-4b8c-4f9b-9ab2-1695af73555f None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:06.236055 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 154/303] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:03:06 2022] GET /identity/v3/users/06a5ce75a5454e258837036f69e5daa1 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:06.237543 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37f101-d03d-4acb-9441-e9f0eec55c3b None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:06.238058 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37f101-d03d-4acb-9441-e9f0eec55c3b None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:06.238590 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37f101-d03d-4acb-9441-e9f0eec55c3b None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:06.240155 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 150/304] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:03:06.241635 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab4406-4b8c-4f9b-9ab2-1695af73555f None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:06.245838 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce135c-4150-44f0-8adc-f4a370cc9c8d None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:06.246350 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce135c-4150-44f0-8adc-f4a370cc9c8d None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:06.246770 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce135c-4150-44f0-8adc-f4a370cc9c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:06.267138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-36ce135c-4150-44f0-8adc-f4a370cc9c8d None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:06.268447 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-36ce135c-4150-44f0-8adc-f4a370cc9c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:06.350362 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 151/305] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:03:06.366041 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab4406-4b8c-4f9b-9ab2-1695af73555f None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:06.372797 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce135c-4150-44f0-8adc-f4a370cc9c8d None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:06.382293 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:06.414972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661502e6-e5aa-4aa6-9d8f-2def2e525978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:06.416216 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661502e6-e5aa-4aa6-9d8f-2def2e525978 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:06.416730 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661502e6-e5aa-4aa6-9d8f-2def2e525978 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:06.417201 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661502e6-e5aa-4aa6-9d8f-2def2e525978 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:06.418892 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661502e6-e5aa-4aa6-9d8f-2def2e525978 None admin] RBAC: Adding query filter params (role.id=79ee931fb56e4180984d7b16ab42999f, user.id=06a5ce75a5454e258837036f69e5daa1, scope.system=all) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:06.419425 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661502e6-e5aa-4aa6-9d8f-2def2e525978 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:06.421892 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661502e6-e5aa-4aa6-9d8f-2def2e525978 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:06.430626 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 155/306] 10.222.0.39 () {56 vars in 1308 bytes} [Wed May 25 15:03:06 2022] GET /identity/v3/role_assignments?user.id=06a5ce75a5454e258837036f69e5daa1&scope.system=all&role.id=79ee931fb56e4180984d7b16ab42999f => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:06.500186 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce135c-4150-44f0-8adc-f4a370cc9c8d None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:06.541383 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f32756-89cb-494b-86b1-1ee1518a61c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:06.542687 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f32756-89cb-494b-86b1-1ee1518a61c3 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:06.543196 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f32756-89cb-494b-86b1-1ee1518a61c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:06.543669 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f32756-89cb-494b-86b1-1ee1518a61c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:06.559348 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f32756-89cb-494b-86b1-1ee1518a61c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:06.568560 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-22f32756-89cb-494b-86b1-1ee1518a61c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:03:06.568560 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:06.568560 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:06.568560 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:06.568560 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:06.568560 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:06.568560 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:06.568560 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:06.568560 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:06.568560 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:06.568560 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:06.568560 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:06.568560 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:06.568560 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:06.568560 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:06.568560 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:06.569501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:06.569501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:06.569501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:06.569501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:06.569501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:06.569501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:06.569501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:06.569501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:06.569501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:06.569501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:06.569501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:06.569501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:06.569501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:06.569501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:06.569501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:06.569501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:06.570309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:06.570309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:06.570309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:06.570309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:06.570309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:06.570309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:06.570309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:06.570309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:06.570309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:06.570309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:06.570309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:03:06.570309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:06.570309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 152/307] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:03:06.576299 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661502e6-e5aa-4aa6-9d8f-2def2e525978 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:06.636159 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:06.697912 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661502e6-e5aa-4aa6-9d8f-2def2e525978 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:06.734158 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3eaaf6-4163-4a0e-abc8-8a186d6eab43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:06.734743 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3eaaf6-4163-4a0e-abc8-8a186d6eab43 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:06.735026 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3eaaf6-4163-4a0e-abc8-8a186d6eab43 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:06.735302 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3eaaf6-4163-4a0e-abc8-8a186d6eab43 None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:06.736056 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3eaaf6-4163-4a0e-abc8-8a186d6eab43 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:06.736361 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3eaaf6-4163-4a0e-abc8-8a186d6eab43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:06.737753 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3eaaf6-4163-4a0e-abc8-8a186d6eab43 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:06.751799 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 156/308] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:03:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:06.753390 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f32756-89cb-494b-86b1-1ee1518a61c3 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:06.800594 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16d5b6-39fe-4c1f-bfa5-64b2f0461f3f None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:06.800914 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16d5b6-39fe-4c1f-bfa5-64b2f0461f3f None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:06.801181 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16d5b6-39fe-4c1f-bfa5-64b2f0461f3f None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:06.802570 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 157/309] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:06.808018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89294f2b-4f80-4681-a6b2-65df6758e83c None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:06.808305 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89294f2b-4f80-4681-a6b2-65df6758e83c None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:06.808579 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89294f2b-4f80-4681-a6b2-65df6758e83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:06.826980 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-89294f2b-4f80-4681-a6b2-65df6758e83c None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:06.828473 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-89294f2b-4f80-4681-a6b2-65df6758e83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:06.835765 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:06.883428 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f32756-89cb-494b-86b1-1ee1518a61c3 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:06.922793 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 158/310] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:06.925771 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8357e9-0308-4f3a-a6cb-08923b2c9606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:06.926933 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8357e9-0308-4f3a-a6cb-08923b2c9606 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:06.927404 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8357e9-0308-4f3a-a6cb-08923b2c9606 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:06.927862 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8357e9-0308-4f3a-a6cb-08923b2c9606 None admin] PATH_INFO: `/v3/users/03d8c2818b524f51bb829e6bfec48ccc` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:06.929572 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8357e9-0308-4f3a-a6cb-08923b2c9606 None admin] RBAC: Authorizing `identity:get_user(user_id=03d8c2818b524f51bb829e6bfec48ccc)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:06.931247 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8357e9-0308-4f3a-a6cb-08923b2c9606 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:06.937452 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 153/311] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:03:06 2022] GET /identity/v3/users/03d8c2818b524f51bb829e6bfec48ccc => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:06.938903 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89294f2b-4f80-4681-a6b2-65df6758e83c None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:06.939304 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8357e9-0308-4f3a-a6cb-08923b2c9606 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:06.985291 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:07.047298 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89294f2b-4f80-4681-a6b2-65df6758e83c None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:07.076093 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8357e9-0308-4f3a-a6cb-08923b2c9606 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:07.086621 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f84a2f-c6ea-4c42-b279-c10c62dbc7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:07.087550 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f84a2f-c6ea-4c42-b279-c10c62dbc7b1 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:07.087924 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f84a2f-c6ea-4c42-b279-c10c62dbc7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:07.088290 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f84a2f-c6ea-4c42-b279-c10c62dbc7b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:07.101565 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f84a2f-c6ea-4c42-b279-c10c62dbc7b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:07.110575 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-67f84a2f-c6ea-4c42-b279-c10c62dbc7b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:03:07.110575 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:07.110575 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:07.110575 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:07.110575 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:07.110575 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:07.110575 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:07.110575 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:07.110575 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:07.110575 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:07.110575 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:07.110575 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:07.110575 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:07.110575 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:07.110575 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:07.110575 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:07.111670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:07.111670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:07.111670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:07.111670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:07.111670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:07.111670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:07.111670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:07.111670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:07.111670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:07.111670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:07.111670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:07.111670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:07.111670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:07.111670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:07.111670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:07.111670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:07.112644 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:07.112644 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:07.112644 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:07.112644 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:07.112644 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:07.112644 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:07.112644 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:07.112644 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:07.112644 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:07.112644 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:07.112644 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:03:07.112644 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:07.119477 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 159/312] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:07.120762 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f84a2f-c6ea-4c42-b279-c10c62dbc7b1 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:07.122937 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba70930-c176-42db-93ef-52e307af552c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:07.124127 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba70930-c176-42db-93ef-52e307af552c None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:07.124603 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba70930-c176-42db-93ef-52e307af552c None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:07.125012 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba70930-c176-42db-93ef-52e307af552c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:07.128979 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:07.216683 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba70930-c176-42db-93ef-52e307af552c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:07.219539 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba70930-c176-42db-93ef-52e307af552c None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:07.234413 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:07.238738 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f84a2f-c6ea-4c42-b279-c10c62dbc7b1 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:07.285525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6a271-ef75-4bed-ad5d-5b276587ba82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:07.286133 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6a271-ef75-4bed-ad5d-5b276587ba82 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:07.286464 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6a271-ef75-4bed-ad5d-5b276587ba82 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:07.286750 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6a271-ef75-4bed-ad5d-5b276587ba82 None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:07.287507 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6a271-ef75-4bed-ad5d-5b276587ba82 None admin] RBAC: Adding query filter params (name=member) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:07.287816 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6a271-ef75-4bed-ad5d-5b276587ba82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:07.289222 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6a271-ef75-4bed-ad5d-5b276587ba82 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:07.298795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 160/313] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:03:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:07.309122 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6a271-ef75-4bed-ad5d-5b276587ba82 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:07.350389 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 154/314] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:03:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 15:03:07.356096 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba70930-c176-42db-93ef-52e307af552c None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:07.393563 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:07.417262 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6a271-ef75-4bed-ad5d-5b276587ba82 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:07.468735 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84dce9-8679-499d-a4ab-9cfcaf41a0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:07.470547 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84dce9-8679-499d-a4ab-9cfcaf41a0ea None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:07.471007 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84dce9-8679-499d-a4ab-9cfcaf41a0ea None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:07.471475 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84dce9-8679-499d-a4ab-9cfcaf41a0ea None admin] PATH_INFO: `/v3/users/9cb2bec062a14a2ab1de3242be4dcc7b` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:07.472908 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84dce9-8679-499d-a4ab-9cfcaf41a0ea None admin] RBAC: Authorizing `identity:get_user(user_id=9cb2bec062a14a2ab1de3242be4dcc7b)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:07.473413 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba70930-c176-42db-93ef-52e307af552c None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:07.474775 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84dce9-8679-499d-a4ab-9cfcaf41a0ea None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:07.477162 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 161/315] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:03:07 2022] GET /identity/v3/users/9cb2bec062a14a2ab1de3242be4dcc7b => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:07.482310 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84dce9-8679-499d-a4ab-9cfcaf41a0ea None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:07.514732 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cbad1-0009-4c42-85df-f186cdddaa35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:07.515823 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cbad1-0009-4c42-85df-f186cdddaa35 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:07.522257 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cbad1-0009-4c42-85df-f186cdddaa35 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:07.522257 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cbad1-0009-4c42-85df-f186cdddaa35 None admin] PATH_INFO: `/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:07.522257 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61cbad1-0009-4c42-85df-f186cdddaa35 None admin] RBAC: Authorizing `identity:get_project(project_id=5ffc3171df904ff0a47f7fb65d9090cb)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:07.522257 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61cbad1-0009-4c42-85df-f186cdddaa35 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:07.526270 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:07.526383 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 155/316] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:03:07 2022] GET /identity/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:07.527710 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cbad1-0009-4c42-85df-f186cdddaa35 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:07.602043 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84dce9-8679-499d-a4ab-9cfcaf41a0ea None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:07.637731 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf57e7-6663-4423-bd8d-0e5ab8e15cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:07.638731 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf57e7-6663-4423-bd8d-0e5ab8e15cf7 None admin] REQUEST_METHOD: `PUT` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:07.639011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf57e7-6663-4423-bd8d-0e5ab8e15cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:07.639288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf57e7-6663-4423-bd8d-0e5ab8e15cf7 None admin] PATH_INFO: `/v3/system/users/9cb2bec062a14a2ab1de3242be4dcc7b/roles/3ddf578e07094ecd820c44387851dbb8` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:07.641052 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf57e7-6663-4423-bd8d-0e5ab8e15cf7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9cb2bec062a14a2ab1de3242be4dcc7b, role_id=3ddf578e07094ecd820c44387851dbb8)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:07.641334 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cbad1-0009-4c42-85df-f186cdddaa35 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:07.642469 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf57e7-6663-4423-bd8d-0e5ab8e15cf7 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:07.642970 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:07.657453 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 162/317] 10.222.0.39 () {58 vars in 1334 bytes} [Wed May 25 15:03:07 2022] PUT /identity/v3/system/users/9cb2bec062a14a2ab1de3242be4dcc7b/roles/3ddf578e07094ecd820c44387851dbb8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:03:07.696704 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4b1b5-b53e-4f80-98a2-b73b62ab94a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:07.697474 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4b1b5-b53e-4f80-98a2-b73b62ab94a5 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:07.697810 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4b1b5-b53e-4f80-98a2-b73b62ab94a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:07.698118 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4b1b5-b53e-4f80-98a2-b73b62ab94a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:07.699095 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4b1b5-b53e-4f80-98a2-b73b62ab94a5 None admin] RBAC: Adding query filter params (role.id=79ee931fb56e4180984d7b16ab42999f, scope.project.id=5ffc3171df904ff0a47f7fb65d9090cb, user.id=03d8c2818b524f51bb829e6bfec48ccc) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:07.699407 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4b1b5-b53e-4f80-98a2-b73b62ab94a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:07.700948 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4b1b5-b53e-4f80-98a2-b73b62ab94a5 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:07.708724 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 156/318] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:03:07 2022] GET /identity/v3/role_assignments?user.id=03d8c2818b524f51bb829e6bfec48ccc&scope.project.id=5ffc3171df904ff0a47f7fb65d9090cb&role.id=79ee931fb56e4180984d7b16ab42999f => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:08.445352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bee437-4ea3-4eff-a6d6-b7205120d339 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:08.445785 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bee437-4ea3-4eff-a6d6-b7205120d339 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:08.445891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bee437-4ea3-4eff-a6d6-b7205120d339 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:08.449492 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 163/319] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:08.455651 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc06a1c-b0b2-4e76-87bb-1e244e670bf5 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:08.455933 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc06a1c-b0b2-4e76-87bb-1e244e670bf5 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:08.456221 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc06a1c-b0b2-4e76-87bb-1e244e670bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:08.477994 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-ffc06a1c-b0b2-4e76-87bb-1e244e670bf5 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:08.479479 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-ffc06a1c-b0b2-4e76-87bb-1e244e670bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:08.555931 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 157/320] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:08.579315 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bee437-4ea3-4eff-a6d6-b7205120d339 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:08.685246 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:08.696029 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bee437-4ea3-4eff-a6d6-b7205120d339 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:08.736567 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a7ed8-f81a-4e23-9825-4a20ee4afb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:08.737390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a7ed8-f81a-4e23-9825-4a20ee4afb2c None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:08.737671 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a7ed8-f81a-4e23-9825-4a20ee4afb2c None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:08.737945 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a7ed8-f81a-4e23-9825-4a20ee4afb2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:08.739323 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a7ed8-f81a-4e23-9825-4a20ee4afb2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:08.740782 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a7ed8-f81a-4e23-9825-4a20ee4afb2c None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:08.742656 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 164/321] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:08.749533 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc06a1c-b0b2-4e76-87bb-1e244e670bf5 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:08.858768 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:08.865595 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc06a1c-b0b2-4e76-87bb-1e244e670bf5 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:08.903654 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b74c2-50d0-4130-86cd-609a652d7b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:08.904344 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b74c2-50d0-4130-86cd-609a652d7b83 None admin] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:08.904618 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b74c2-50d0-4130-86cd-609a652d7b83 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:08.904887 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b74c2-50d0-4130-86cd-609a652d7b83 None admin] PATH_INFO: `/v3/groups` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:08.905590 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b74c2-50d0-4130-86cd-609a652d7b83 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:08.907099 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b74c2-50d0-4130-86cd-609a652d7b83 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:08.929814 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 158/322] 10.222.0.39 () {60 vars in 1134 bytes} [Wed May 25 15:03:08 2022] POST /identity/v3/groups => generated 226 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:03:08.931922 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0a726-a5fb-420f-ac95-fffac2359e52 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:08.932208 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0a726-a5fb-420f-ac95-fffac2359e52 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:08.932547 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0a726-a5fb-420f-ac95-fffac2359e52 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:08.934115 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 165/323] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:08.940621 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03148328-8bd1-47d8-b0d8-ec219f6619c4 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:08.940947 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03148328-8bd1-47d8-b0d8-ec219f6619c4 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:08.941201 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03148328-8bd1-47d8-b0d8-ec219f6619c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:08.960379 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-03148328-8bd1-47d8-b0d8-ec219f6619c4 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:08.961560 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-03148328-8bd1-47d8-b0d8-ec219f6619c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:09.048966 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 159/324] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:09.073278 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0a726-a5fb-420f-ac95-fffac2359e52 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:09.188163 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0a726-a5fb-420f-ac95-fffac2359e52 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:09.224670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8135c-26cb-490f-abee-70fdb7b02816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:09.225771 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8135c-26cb-490f-abee-70fdb7b02816 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:09.226218 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8135c-26cb-490f-abee-70fdb7b02816 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:09.226679 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8135c-26cb-490f-abee-70fdb7b02816 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:09.238788 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8135c-26cb-490f-abee-70fdb7b02816 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:09.247227 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-5fe8135c-26cb-490f-abee-70fdb7b02816 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:03:09.247227 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:09.247227 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:09.247227 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:09.247227 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:09.247227 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:09.247227 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:09.247227 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:09.247227 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:09.247227 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:09.247227 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:09.247227 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:09.247227 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:09.247227 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:09.247227 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:09.247227 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:09.248188 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:09.248188 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:09.248188 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:09.248188 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:09.248188 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:09.248188 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:09.248188 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:09.248188 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:09.248188 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:09.248188 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:09.248188 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:09.248188 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:09.248188 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:09.248188 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:09.248188 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:09.248188 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:09.248984 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:09.248984 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:09.248984 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:09.248984 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:09.248984 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:09.248984 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:09.248984 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:09.248984 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:09.248984 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:09.248984 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:09.248984 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:03:09.248984 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:09.250216 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 166/325] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:09.256718 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03148328-8bd1-47d8-b0d8-ec219f6619c4 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:09.359490 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:09.377298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03148328-8bd1-47d8-b0d8-ec219f6619c4 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:09.417365 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa544b6-baab-4c5f-b8c8-7609da1617d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:09.418040 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa544b6-baab-4c5f-b8c8-7609da1617d3 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:09.418352 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa544b6-baab-4c5f-b8c8-7609da1617d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:09.418624 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa544b6-baab-4c5f-b8c8-7609da1617d3 None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:09.419365 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa544b6-baab-4c5f-b8c8-7609da1617d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:09.419667 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa544b6-baab-4c5f-b8c8-7609da1617d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:09.421154 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa544b6-baab-4c5f-b8c8-7609da1617d3 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:09.430981 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 160/326] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:03:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:09.438092 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8135c-26cb-490f-abee-70fdb7b02816 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:09.489844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:09.589508 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8135c-26cb-490f-abee-70fdb7b02816 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:09.629729 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17fe3d-294d-44c2-a13d-8466d7cf0a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:09.630791 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17fe3d-294d-44c2-a13d-8466d7cf0a5d None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:09.631074 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17fe3d-294d-44c2-a13d-8466d7cf0a5d None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:09.631346 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17fe3d-294d-44c2-a13d-8466d7cf0a5d None admin] PATH_INFO: `/v3/users/06a5ce75a5454e258837036f69e5daa1` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:09.632548 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17fe3d-294d-44c2-a13d-8466d7cf0a5d None admin] RBAC: Authorizing `identity:get_user(user_id=06a5ce75a5454e258837036f69e5daa1)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:09.633997 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17fe3d-294d-44c2-a13d-8466d7cf0a5d None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:09.635968 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 167/327] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:03:09 2022] GET /identity/v3/users/06a5ce75a5454e258837036f69e5daa1 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:09.647456 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa544b6-baab-4c5f-b8c8-7609da1617d3 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:09.783801 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa544b6-baab-4c5f-b8c8-7609da1617d3 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:09.835065 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23eae8-35c3-4478-864e-e03c12d2ef35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:09.836275 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23eae8-35c3-4478-864e-e03c12d2ef35 None admin] REQUEST_METHOD: `PUT` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:09.836737 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23eae8-35c3-4478-864e-e03c12d2ef35 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:09.837179 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23eae8-35c3-4478-864e-e03c12d2ef35 None admin] PATH_INFO: `/v3/system/users/06a5ce75a5454e258837036f69e5daa1/roles/79ee931fb56e4180984d7b16ab42999f` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:09.840598 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23eae8-35c3-4478-864e-e03c12d2ef35 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=06a5ce75a5454e258837036f69e5daa1, role_id=79ee931fb56e4180984d7b16ab42999f)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:09.842201 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23eae8-35c3-4478-864e-e03c12d2ef35 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:09.857095 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 161/328] 10.222.0.39 () {58 vars in 1334 bytes} [Wed May 25 15:03:09 2022] PUT /identity/v3/system/users/06a5ce75a5454e258837036f69e5daa1/roles/79ee931fb56e4180984d7b16ab42999f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:10.050963 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3a46b-b451-4be4-8b3d-12115a005a15 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:10.051991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3a46b-b451-4be4-8b3d-12115a005a15 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:10.052478 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3a46b-b451-4be4-8b3d-12115a005a15 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:10.054057 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 168/329] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:10.061304 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152d8af-8bea-4823-a918-1555296f4fb5 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:10.062098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152d8af-8bea-4823-a918-1555296f4fb5 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:10.062648 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152d8af-8bea-4823-a918-1555296f4fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:10.088167 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-2152d8af-8bea-4823-a918-1555296f4fb5 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:10.089851 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-2152d8af-8bea-4823-a918-1555296f4fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:10.101672 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:10.173191 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 162/330] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:10.201403 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3a46b-b451-4be4-8b3d-12115a005a15 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:10.313001 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:10.320835 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3a46b-b451-4be4-8b3d-12115a005a15 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:10.358364 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91bce9-907b-47df-8d53-587610684838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:10.359444 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91bce9-907b-47df-8d53-587610684838 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:10.359732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91bce9-907b-47df-8d53-587610684838 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:10.359998 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91bce9-907b-47df-8d53-587610684838 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:10.370926 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91bce9-907b-47df-8d53-587610684838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:10.378901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-7f91bce9-907b-47df-8d53-587610684838 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:03:10.378901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:10.378901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:10.378901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:10.378901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:10.378901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:10.378901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:10.378901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:10.378901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:10.378901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:10.378901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:10.378901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:10.378901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:10.378901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:10.378901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:10.378901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:10.379784 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:10.379784 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:10.379784 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:10.379784 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:10.379784 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:10.379784 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:10.379784 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:10.379784 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:10.379784 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:10.379784 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:10.379784 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:10.379784 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:10.379784 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:10.379784 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:10.379784 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:10.379784 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:10.380565 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:10.380565 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:10.380565 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:10.380565 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:10.380565 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:10.380565 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:10.380565 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:10.380565 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:10.380565 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:10.380565 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:10.380565 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:03:10.380565 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:10.380565 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 169/331] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:10.386294 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152d8af-8bea-4823-a918-1555296f4fb5 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:10.518022 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152d8af-8bea-4823-a918-1555296f4fb5 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:10.560874 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0bc5c-da6d-416a-833f-062f54c90ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:10.561549 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0bc5c-da6d-416a-833f-062f54c90ef3 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:10.561894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0bc5c-da6d-416a-833f-062f54c90ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:10.562168 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0bc5c-da6d-416a-833f-062f54c90ef3 None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:10.563097 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0bc5c-da6d-416a-833f-062f54c90ef3 None admin] RBAC: Adding query filter params (name=member) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:10.563392 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0bc5c-da6d-416a-833f-062f54c90ef3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:10.564794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0bc5c-da6d-416a-833f-062f54c90ef3 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:10.574861 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 163/332] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:03:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:10.580453 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91bce9-907b-47df-8d53-587610684838 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:10.694332 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91bce9-907b-47df-8d53-587610684838 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:10.730554 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941f45f-9a40-4330-b866-eb0b6ec38e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:10.731442 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941f45f-9a40-4330-b866-eb0b6ec38e99 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:10.731773 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941f45f-9a40-4330-b866-eb0b6ec38e99 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:10.732043 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941f45f-9a40-4330-b866-eb0b6ec38e99 None admin] PATH_INFO: `/v3/users/9cb2bec062a14a2ab1de3242be4dcc7b` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:10.733305 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941f45f-9a40-4330-b866-eb0b6ec38e99 None admin] RBAC: Authorizing `identity:get_user(user_id=9cb2bec062a14a2ab1de3242be4dcc7b)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:10.734918 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941f45f-9a40-4330-b866-eb0b6ec38e99 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:10.736568 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 170/333] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:03:10 2022] GET /identity/v3/users/9cb2bec062a14a2ab1de3242be4dcc7b => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:10.742866 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0bc5c-da6d-416a-833f-062f54c90ef3 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:10.747101 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:10.869268 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0bc5c-da6d-416a-833f-062f54c90ef3 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:10.911439 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924dd84e-1dd3-4055-a04b-afce2712cd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:10.912338 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dd84e-1dd3-4055-a04b-afce2712cd7d None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:10.912757 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dd84e-1dd3-4055-a04b-afce2712cd7d None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:10.913164 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dd84e-1dd3-4055-a04b-afce2712cd7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:10.914124 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dd84e-1dd3-4055-a04b-afce2712cd7d None admin] RBAC: Adding query filter params (role.id=3ddf578e07094ecd820c44387851dbb8, user.id=9cb2bec062a14a2ab1de3242be4dcc7b, scope.system=all) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:10.914690 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dd84e-1dd3-4055-a04b-afce2712cd7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:10.916300 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dd84e-1dd3-4055-a04b-afce2712cd7d None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:10.929575 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 164/334] 10.222.0.39 () {56 vars in 1308 bytes} [Wed May 25 15:03:10 2022] GET /identity/v3/role_assignments?user.id=9cb2bec062a14a2ab1de3242be4dcc7b&scope.system=all&role.id=3ddf578e07094ecd820c44387851dbb8 => generated 510 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:12.193644 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878b553-5eb1-4aeb-93a2-8316c219242b None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:12.194206 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878b553-5eb1-4aeb-93a2-8316c219242b None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:12.194206 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878b553-5eb1-4aeb-93a2-8316c219242b None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:12.195981 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 171/335] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:12.201005 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8837b1-5072-4c8c-a112-b9d5a90c4af9 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:12.201411 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8837b1-5072-4c8c-a112-b9d5a90c4af9 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:12.201598 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8837b1-5072-4c8c-a112-b9d5a90c4af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:12.219154 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-6e8837b1-5072-4c8c-a112-b9d5a90c4af9 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:12.220358 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-6e8837b1-5072-4c8c-a112-b9d5a90c4af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:12.300420 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:12.313008 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 165/336] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:12.362832 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878b553-5eb1-4aeb-93a2-8316c219242b None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:12.393100 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:12.480645 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba538a-eb76-4376-9150-218eab6239ef None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:12.480979 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba538a-eb76-4376-9150-218eab6239ef None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:12.481216 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba538a-eb76-4376-9150-218eab6239ef None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:12.487513 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 166/337] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:03:12.493497 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac92c0e-cfd1-4e67-9ce7-8317dd1ecdc0 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:12.493914 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac92c0e-cfd1-4e67-9ce7-8317dd1ecdc0 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:12.494205 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac92c0e-cfd1-4e67-9ce7-8317dd1ecdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:12.521024 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-4ac92c0e-cfd1-4e67-9ce7-8317dd1ecdc0 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:12.529738 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-4ac92c0e-cfd1-4e67-9ce7-8317dd1ecdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:12.561144 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878b553-5eb1-4aeb-93a2-8316c219242b None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:12.620743 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 167/338] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:12.643676 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060ff96-f5dd-4c64-b65a-4fa96de643dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:12.644503 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060ff96-f5dd-4c64-b65a-4fa96de643dc None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:12.644784 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060ff96-f5dd-4c64-b65a-4fa96de643dc None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:12.645053 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060ff96-f5dd-4c64-b65a-4fa96de643dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:12.649974 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac92c0e-cfd1-4e67-9ce7-8317dd1ecdc0 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:12.671468 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060ff96-f5dd-4c64-b65a-4fa96de643dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:12.680866 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-2060ff96-f5dd-4c64-b65a-4fa96de643dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:03:12.680866 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:12.680866 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:12.680866 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:12.680866 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:12.680866 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:12.680866 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:12.680866 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:12.680866 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:12.680866 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:12.680866 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:12.680866 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:12.680866 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:12.680866 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:12.680866 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:12.680866 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:12.681761 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:12.681761 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:12.681761 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:12.681761 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:12.681761 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:12.681761 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:12.681761 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:12.681761 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:12.681761 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:12.681761 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:12.681761 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:12.681761 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:12.681761 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:12.681761 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:12.681761 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:12.681761 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:12.682567 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:12.682567 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:12.682567 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:12.682567 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:12.682567 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:12.682567 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:12.682567 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:12.682567 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:12.682567 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:12.682567 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:12.682567 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:03:12.682567 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:12.686448 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 172/339] 10.222.0.39 () {56 vars in 1114 bytes} [Wed May 25 15:03:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:12.692020 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060ff96-f5dd-4c64-b65a-4fa96de643dc None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:12.766561 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac92c0e-cfd1-4e67-9ce7-8317dd1ecdc0 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:12.796887 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:12.805936 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bef948-2732-4c86-8a20-c9114d146ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:12.807066 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bef948-2732-4c86-8a20-c9114d146ed4 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:12.807470 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bef948-2732-4c86-8a20-c9114d146ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:12.807841 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bef948-2732-4c86-8a20-c9114d146ed4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:12.820162 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bef948-2732-4c86-8a20-c9114d146ed4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:12.829038 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-f9bef948-2732-4c86-8a20-c9114d146ed4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:03:12.829038 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:12.829038 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:12.829038 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:12.829038 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:12.829038 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:12.829038 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:12.829038 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:12.829038 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:12.829038 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:12.829038 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:12.829038 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:12.829038 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:12.829038 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:12.829038 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:12.829038 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:12.830092 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:12.830092 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:12.830092 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:12.830092 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:12.830092 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:12.830092 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:12.830092 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:12.830092 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:12.830092 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:12.830092 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:12.830092 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:12.830092 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:12.830092 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:12.830092 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:12.830092 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:12.830092 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:12.830908 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:12.830908 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:12.830908 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:12.830908 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:12.830908 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:12.830908 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:12.830908 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:12.830908 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:12.830908 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:12.830908 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:12.830908 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:03:12.830908 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:12.831497 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 168/340] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:12.837261 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bef948-2732-4c86-8a20-c9114d146ed4 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:12.893855 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:12.945782 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bef948-2732-4c86-8a20-c9114d146ed4 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:12.981401 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e809429-1ab1-47e2-a094-8c21e8bab7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:12.982089 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e809429-1ab1-47e2-a094-8c21e8bab7c1 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:12.982404 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e809429-1ab1-47e2-a094-8c21e8bab7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:12.982858 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e809429-1ab1-47e2-a094-8c21e8bab7c1 None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:12.983621 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e809429-1ab1-47e2-a094-8c21e8bab7c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:12.984018 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e809429-1ab1-47e2-a094-8c21e8bab7c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:12.985173 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060ff96-f5dd-4c64-b65a-4fa96de643dc None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:12.985430 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e809429-1ab1-47e2-a094-8c21e8bab7c1 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:12.998595 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 169/341] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:03:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:13.003460 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e809429-1ab1-47e2-a094-8c21e8bab7c1 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:13.033614 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a87ec-a210-4ec3-bff7-3c03df9a557f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:13.034284 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a87ec-a210-4ec3-bff7-3c03df9a557f None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:13.034540 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a87ec-a210-4ec3-bff7-3c03df9a557f None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:13.034827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a87ec-a210-4ec3-bff7-3c03df9a557f None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:13.035576 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a87ec-a210-4ec3-bff7-3c03df9a557f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:13.035879 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a87ec-a210-4ec3-bff7-3c03df9a557f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:13.037278 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a87ec-a210-4ec3-bff7-3c03df9a557f None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:13.055337 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 173/342] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:03:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:13.082318 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:13.083355 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a87ec-a210-4ec3-bff7-3c03df9a557f None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:13.145740 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e809429-1ab1-47e2-a094-8c21e8bab7c1 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:13.187929 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c8cea-1e19-401c-869e-be653e723d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:13.188621 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c8cea-1e19-401c-869e-be653e723d32 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:13.188921 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c8cea-1e19-401c-869e-be653e723d32 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:13.189203 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c8cea-1e19-401c-869e-be653e723d32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:13.265473 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c8cea-1e19-401c-869e-be653e723d32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:13.267008 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c8cea-1e19-401c-869e-be653e723d32 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:13.320406 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a87ec-a210-4ec3-bff7-3c03df9a557f None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:13.336358 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:13.381644 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244093c-04f2-41d5-b230-582dedcc55f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:13.382331 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244093c-04f2-41d5-b230-582dedcc55f8 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:13.382617 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244093c-04f2-41d5-b230-582dedcc55f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:13.382890 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244093c-04f2-41d5-b230-582dedcc55f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:13.385628 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 170/343] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:03:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 15:03:13.398312 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c8cea-1e19-401c-869e-be653e723d32 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:13.410613 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:13.523942 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244093c-04f2-41d5-b230-582dedcc55f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:13.527364 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244093c-04f2-41d5-b230-582dedcc55f8 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:13.607608 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c8cea-1e19-401c-869e-be653e723d32 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:13.685530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b7caf-cbb9-424e-b0fe-9a9fc4d1d7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:13.686443 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b7caf-cbb9-424e-b0fe-9a9fc4d1d7ca None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:13.686725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b7caf-cbb9-424e-b0fe-9a9fc4d1d7ca None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:13.687021 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b7caf-cbb9-424e-b0fe-9a9fc4d1d7ca None admin] PATH_INFO: `/v3/projects/d8426986884141db8d183e5b9a859a3b` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:13.690268 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b7caf-cbb9-424e-b0fe-9a9fc4d1d7ca None admin] RBAC: Authorizing `identity:get_project(project_id=d8426986884141db8d183e5b9a859a3b)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:13.692661 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b7caf-cbb9-424e-b0fe-9a9fc4d1d7ca None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:13.695282 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 171/344] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:03:13 2022] GET /identity/v3/projects/d8426986884141db8d183e5b9a859a3b => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:13.696485 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c934e-f310-41ef-8c78-55204a721ad9 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:13.696766 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c934e-f310-41ef-8c78-55204a721ad9 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:13.697040 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c934e-f310-41ef-8c78-55204a721ad9 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:13.698248 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 172/345] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:13.705740 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c79a2-491f-43c1-811e-6758a21b4065 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:13.706104 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c79a2-491f-43c1-811e-6758a21b4065 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:13.706339 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c79a2-491f-43c1-811e-6758a21b4065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:13.726015 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-a43c79a2-491f-43c1-811e-6758a21b4065 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:13.727248 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-a43c79a2-491f-43c1-811e-6758a21b4065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:13.742598 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:13.749648 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 174/346] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:03:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:03:13.751225 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244093c-04f2-41d5-b230-582dedcc55f8 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:13.812208 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 173/347] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:13.813124 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c79a2-491f-43c1-811e-6758a21b4065 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:13.835202 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:13.910275 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244093c-04f2-41d5-b230-582dedcc55f8 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:13.950721 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69799a02-187a-47a4-a1d9-4d2deb910ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:13.951593 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69799a02-187a-47a4-a1d9-4d2deb910ad7 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:13.951867 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69799a02-187a-47a4-a1d9-4d2deb910ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:13.952134 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69799a02-187a-47a4-a1d9-4d2deb910ad7 None admin] PATH_INFO: `/v3/groups/726c639c29bc4a158e57e8f7d607d233` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:13.962456 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69799a02-187a-47a4-a1d9-4d2deb910ad7 None admin] RBAC: Authorizing `identity:get_group(group_id=726c639c29bc4a158e57e8f7d607d233)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:13.964073 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69799a02-187a-47a4-a1d9-4d2deb910ad7 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:13.965813 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 175/348] 10.222.0.39 () {56 vars in 1180 bytes} [Wed May 25 15:03:13 2022] GET /identity/v3/groups/726c639c29bc4a158e57e8f7d607d233 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:13.966445 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c79a2-491f-43c1-811e-6758a21b4065 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:13.967137 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3085f4-59ef-4c26-859f-2309e918e908 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:13.967422 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3085f4-59ef-4c26-859f-2309e918e908 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:13.967695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3085f4-59ef-4c26-859f-2309e918e908 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:13.969191 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 176/349] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:13.974231 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3085f4-59ef-4c26-859f-2309e918e908 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:14.025271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4a0de-987e-4153-be90-19fea370d58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:14.026209 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4a0de-987e-4153-be90-19fea370d58f None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:14.026555 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4a0de-987e-4153-be90-19fea370d58f None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:14.026851 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f4a0de-987e-4153-be90-19fea370d58f None admin] PATH_INFO: `/v3/projects/d8426986884141db8d183e5b9a859a3b` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:14.028766 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f4a0de-987e-4153-be90-19fea370d58f None admin] RBAC: Authorizing `identity:get_project(project_id=d8426986884141db8d183e5b9a859a3b)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:14.030221 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f4a0de-987e-4153-be90-19fea370d58f None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:14.032082 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 174/350] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:03:13 2022] GET /identity/v3/projects/d8426986884141db8d183e5b9a859a3b => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:14.032909 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4a0de-987e-4153-be90-19fea370d58f None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:14.052901 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:14.123949 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3085f4-59ef-4c26-859f-2309e918e908 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:14.127831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:14.171855 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62714abf-1a82-4a21-9758-4aabc473fcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:14.172713 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62714abf-1a82-4a21-9758-4aabc473fcdf None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:14.172996 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62714abf-1a82-4a21-9758-4aabc473fcdf None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:14.173268 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62714abf-1a82-4a21-9758-4aabc473fcdf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:14.173511 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f4a0de-987e-4153-be90-19fea370d58f None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:14.186271 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62714abf-1a82-4a21-9758-4aabc473fcdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:14.197690 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-62714abf-1a82-4a21-9758-4aabc473fcdf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:03:14.197690 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:14.197690 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:14.197690 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:14.197690 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:14.197690 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:14.197690 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:14.197690 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:14.197690 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:14.197690 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:14.197690 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:14.197690 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:14.197690 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:14.197690 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:14.197690 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:14.197690 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:14.198701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:14.198701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:14.198701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:14.198701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:14.198701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:14.198701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:14.198701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:14.198701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:14.198701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:14.198701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:14.198701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:14.198701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:14.198701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:14.198701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:14.198701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:14.198701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:14.199745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:14.199745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:14.199745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:14.199745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:14.199745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:14.199745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:14.199745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:14.199745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:14.199745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:14.199745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:14.199745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:03:14.199745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:14.199745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 177/351] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:14.201012 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc328b-c194-4380-b82f-5c586902a251 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:14.204218 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc328b-c194-4380-b82f-5c586902a251 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:14.204218 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc328b-c194-4380-b82f-5c586902a251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:14.214128 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eeb6dd-b139-41b0-b4e8-841685e4a567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:14.214824 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eeb6dd-b139-41b0-b4e8-841685e4a567 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:14.215111 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eeb6dd-b139-41b0-b4e8-841685e4a567 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:14.215389 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eeb6dd-b139-41b0-b4e8-841685e4a567 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:14.216783 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eeb6dd-b139-41b0-b4e8-841685e4a567 None admin] RBAC: Adding query filter params (group.id=726c639c29bc4a158e57e8f7d607d233, role.id=3ddf578e07094ecd820c44387851dbb8, scope.project.id=d8426986884141db8d183e5b9a859a3b) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:14.217366 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eeb6dd-b139-41b0-b4e8-841685e4a567 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:14.219086 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eeb6dd-b139-41b0-b4e8-841685e4a567 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:14.221136 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-c2cc328b-c194-4380-b82f-5c586902a251 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:14.222364 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-c2cc328b-c194-4380-b82f-5c586902a251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:14.225390 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 175/352] 10.222.0.39 () {56 vars in 1376 bytes} [Wed May 25 15:03:14 2022] GET /identity/v3/role_assignments?group.id=726c639c29bc4a158e57e8f7d607d233&scope.project.id=d8426986884141db8d183e5b9a859a3b&role.id=3ddf578e07094ecd820c44387851dbb8 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:14.227055 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eeb6dd-b139-41b0-b4e8-841685e4a567 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:14.329332 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 178/353] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:14.330984 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10a3fe-fd5e-4b8b-a428-324e5b780d3d None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:14.331272 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10a3fe-fd5e-4b8b-a428-324e5b780d3d None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:14.331548 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10a3fe-fd5e-4b8b-a428-324e5b780d3d None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:14.333004 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 179/354] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:14.333559 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10a3fe-fd5e-4b8b-a428-324e5b780d3d None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:14.373054 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:14.406319 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eeb6dd-b139-41b0-b4e8-841685e4a567 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:14.462226 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b03ba-2fdf-41db-b84f-47b4058a9c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:14.464280 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b03ba-2fdf-41db-b84f-47b4058a9c2b None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:14.464772 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b03ba-2fdf-41db-b84f-47b4058a9c2b None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:14.465352 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b03ba-2fdf-41db-b84f-47b4058a9c2b None admin] PATH_INFO: `/v3/groups/726c639c29bc4a158e57e8f7d607d233` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:14.468075 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b03ba-2fdf-41db-b84f-47b4058a9c2b None admin] RBAC: Authorizing `identity:get_group(group_id=726c639c29bc4a158e57e8f7d607d233)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:14.471783 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b03ba-2fdf-41db-b84f-47b4058a9c2b None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:14.474152 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 176/355] 10.222.0.39 () {56 vars in 1180 bytes} [Wed May 25 15:03:14 2022] GET /identity/v3/groups/726c639c29bc4a158e57e8f7d607d233 => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:14.479902 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2cafc-5a10-4907-b828-3670e111c0eb None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:14.480398 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2cafc-5a10-4907-b828-3670e111c0eb None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:14.480876 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2cafc-5a10-4907-b828-3670e111c0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:14.495746 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:14.504671 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-41c2cafc-5a10-4907-b828-3670e111c0eb None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:14.505949 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10a3fe-fd5e-4b8b-a428-324e5b780d3d None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:14.506445 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-41c2cafc-5a10-4907-b828-3670e111c0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:14.549811 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb29be-e3c1-4414-97fe-9feda78eb1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:14.550902 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb29be-e3c1-4414-97fe-9feda78eb1fd None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:14.551375 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb29be-e3c1-4414-97fe-9feda78eb1fd None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:14.551836 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb29be-e3c1-4414-97fe-9feda78eb1fd None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:14.552767 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb29be-e3c1-4414-97fe-9feda78eb1fd None admin] RBAC: Adding query filter params (name=reader) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:14.553275 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb29be-e3c1-4414-97fe-9feda78eb1fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:14.554870 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb29be-e3c1-4414-97fe-9feda78eb1fd None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:14.566202 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 180/356] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:03:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:14.568145 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb29be-e3c1-4414-97fe-9feda78eb1fd None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:14.605671 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 177/357] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:14.607350 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2cafc-5a10-4907-b828-3670e111c0eb None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:14.689812 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb29be-e3c1-4414-97fe-9feda78eb1fd None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:14.691829 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:14.736639 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2cafc-5a10-4907-b828-3670e111c0eb None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:14.739746 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9367c-d731-415f-8e45-36630ce06b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:14.740244 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9367c-d731-415f-8e45-36630ce06b99 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:14.740529 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9367c-d731-415f-8e45-36630ce06b99 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:14.740800 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9367c-d731-415f-8e45-36630ce06b99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:14.752976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9367c-d731-415f-8e45-36630ce06b99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:14.760964 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-b9e9367c-d731-415f-8e45-36630ce06b99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:03:14.760964 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:14.760964 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:14.760964 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:14.760964 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:14.760964 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:14.760964 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:14.760964 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:14.760964 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:14.760964 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:14.760964 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:14.760964 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:14.760964 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:14.760964 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:14.760964 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:14.760964 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:14.761891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:14.761891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:14.761891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:14.761891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:14.761891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:14.761891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:14.761891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:14.761891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:14.761891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:14.761891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:14.761891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:14.761891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:14.761891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:14.761891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:14.761891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:14.761891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:14.762715 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:14.762715 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:14.762715 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:14.762715 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:14.762715 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:14.762715 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:14.762715 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:14.762715 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:14.762715 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:14.762715 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:14.762715 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:03:14.762715 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:14.762715 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 181/358] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:14.764490 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9367c-d731-415f-8e45-36630ce06b99 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:14.788367 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:14.790628 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e3860-bf21-4160-8fab-da67485a74fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:14.791308 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e3860-bf21-4160-8fab-da67485a74fe None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:14.791591 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e3860-bf21-4160-8fab-da67485a74fe None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:14.791866 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e3860-bf21-4160-8fab-da67485a74fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:14.792960 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e3860-bf21-4160-8fab-da67485a74fe None admin] RBAC: Adding query filter params (group.id=726c639c29bc4a158e57e8f7d607d233, role.id=44e6a84e85f84d5ba38f6ee215622918, scope.project.id=d8426986884141db8d183e5b9a859a3b) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:14.793401 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e3860-bf21-4160-8fab-da67485a74fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:14.794956 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e3860-bf21-4160-8fab-da67485a74fe None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:14.803614 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 178/359] 10.222.0.39 () {56 vars in 1376 bytes} [Wed May 25 15:03:14 2022] GET /identity/v3/role_assignments?group.id=726c639c29bc4a158e57e8f7d607d233&scope.project.id=d8426986884141db8d183e5b9a859a3b&role.id=44e6a84e85f84d5ba38f6ee215622918 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:14.804476 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e3860-bf21-4160-8fab-da67485a74fe None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:14.896142 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9367c-d731-415f-8e45-36630ce06b99 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:14.940412 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a049710-4e54-4394-a546-8c6e11c9ba49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:14.941401 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a049710-4e54-4394-a546-8c6e11c9ba49 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:14.941789 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a049710-4e54-4394-a546-8c6e11c9ba49 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:14.942122 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a049710-4e54-4394-a546-8c6e11c9ba49 None admin] PATH_INFO: `/v3/users/06a5ce75a5454e258837036f69e5daa1` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:14.943555 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a049710-4e54-4394-a546-8c6e11c9ba49 None admin] RBAC: Authorizing `identity:get_user(user_id=06a5ce75a5454e258837036f69e5daa1)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:14.945051 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a049710-4e54-4394-a546-8c6e11c9ba49 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:14.947938 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 182/360] 10.222.0.39 () {56 vars in 1177 bytes} [Wed May 25 15:03:14 2022] GET /identity/v3/users/06a5ce75a5454e258837036f69e5daa1 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:14.949365 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383cb49-77ca-45a7-b0e2-342723462ca4 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:14.949647 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383cb49-77ca-45a7-b0e2-342723462ca4 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:14.950053 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383cb49-77ca-45a7-b0e2-342723462ca4 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:14.951384 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 183/361] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:14.952152 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383cb49-77ca-45a7-b0e2-342723462ca4 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:14.974786 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e3860-bf21-4160-8fab-da67485a74fe None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:15.024109 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394150b8-68d9-42c9-84ef-8b0532e7a64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:15.025481 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394150b8-68d9-42c9-84ef-8b0532e7a64e None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:15.025770 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394150b8-68d9-42c9-84ef-8b0532e7a64e None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:15.026049 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394150b8-68d9-42c9-84ef-8b0532e7a64e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:15.030371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:15.043547 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394150b8-68d9-42c9-84ef-8b0532e7a64e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:15.062667 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-394150b8-68d9-42c9-84ef-8b0532e7a64e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:03:15.062667 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:15.062667 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:15.062667 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:15.062667 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:15.062667 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:15.062667 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:15.062667 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:15.062667 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:15.062667 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:15.062667 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:15.062667 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:15.062667 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:15.062667 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:15.062667 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:15.062667 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:15.063773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:15.063773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:15.063773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:15.063773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:15.063773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:15.063773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:15.063773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:15.063773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:15.063773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:15.063773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:15.063773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:15.063773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:15.063773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:15.063773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:15.063773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:15.063773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:15.064684 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:15.064684 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:15.064684 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:15.064684 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:15.064684 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:15.064684 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:15.064684 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:15.064684 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:15.064684 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:15.064684 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:15.064684 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:03:15.064684 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:15.064684 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 179/362] 10.222.0.39 () {56 vars in 1114 bytes} [Wed May 25 15:03:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:15.065898 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f530cf7-b59e-4dc4-832f-39cd9d6afcbc None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:15.066188 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f530cf7-b59e-4dc4-832f-39cd9d6afcbc None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:15.066834 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f530cf7-b59e-4dc4-832f-39cd9d6afcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:15.071786 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:15.097567 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-7f530cf7-b59e-4dc4-832f-39cd9d6afcbc None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:15.098884 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-7f530cf7-b59e-4dc4-832f-39cd9d6afcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:15.105121 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383cb49-77ca-45a7-b0e2-342723462ca4 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:15.144204 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63591561-6d07-4e49-bf05-7a44e393a21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:15.145298 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63591561-6d07-4e49-bf05-7a44e393a21c None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:15.145837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63591561-6d07-4e49-bf05-7a44e393a21c None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:15.146348 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63591561-6d07-4e49-bf05-7a44e393a21c None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:15.147340 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63591561-6d07-4e49-bf05-7a44e393a21c None admin] RBAC: Adding query filter params (name=member) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:15.147835 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63591561-6d07-4e49-bf05-7a44e393a21c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:15.149531 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63591561-6d07-4e49-bf05-7a44e393a21c None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:15.159556 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 184/363] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:03:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:15.160929 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63591561-6d07-4e49-bf05-7a44e393a21c None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:15.180933 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 180/364] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:15.182271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f530cf7-b59e-4dc4-832f-39cd9d6afcbc None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:15.272495 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63591561-6d07-4e49-bf05-7a44e393a21c None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:15.318193 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a985b7-140b-4a1f-8d5b-a0a470645b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:15.319081 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a985b7-140b-4a1f-8d5b-a0a470645b4d None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:15.319453 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a985b7-140b-4a1f-8d5b-a0a470645b4d None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:15.319820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a985b7-140b-4a1f-8d5b-a0a470645b4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:15.320749 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a985b7-140b-4a1f-8d5b-a0a470645b4d None admin] RBAC: Adding query filter params (role.id=79ee931fb56e4180984d7b16ab42999f, user.id=06a5ce75a5454e258837036f69e5daa1, scope.system=all) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:15.321169 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a985b7-140b-4a1f-8d5b-a0a470645b4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:15.322761 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a985b7-140b-4a1f-8d5b-a0a470645b4d None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:15.341585 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 185/365] 10.222.0.39 () {56 vars in 1308 bytes} [Wed May 25 15:03:15 2022] GET /identity/v3/role_assignments?user.id=06a5ce75a5454e258837036f69e5daa1&scope.system=all&role.id=79ee931fb56e4180984d7b16ab42999f => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:15.342928 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a985b7-140b-4a1f-8d5b-a0a470645b4d None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:15.355371 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:15.404629 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f530cf7-b59e-4dc4-832f-39cd9d6afcbc None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:15.505128 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:15.538730 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a985b7-140b-4a1f-8d5b-a0a470645b4d None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:15.544609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4aa5d3-6401-4411-9876-e7c201e736b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:15.545326 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aa5d3-6401-4411-9876-e7c201e736b1 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:15.545611 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aa5d3-6401-4411-9876-e7c201e736b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:15.545890 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aa5d3-6401-4411-9876-e7c201e736b1 None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:15.546807 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4aa5d3-6401-4411-9876-e7c201e736b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:15.547123 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4aa5d3-6401-4411-9876-e7c201e736b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:15.548561 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4aa5d3-6401-4411-9876-e7c201e736b1 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:15.569872 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 181/366] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:03:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:15.570619 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4aa5d3-6401-4411-9876-e7c201e736b1 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:15.606405 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd76cca-b1e6-46c4-86ec-0fb5f2776e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:15.607516 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd76cca-b1e6-46c4-86ec-0fb5f2776e1e None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:15.608186 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd76cca-b1e6-46c4-86ec-0fb5f2776e1e None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:15.609098 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd76cca-b1e6-46c4-86ec-0fb5f2776e1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:15.704981 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4aa5d3-6401-4411-9876-e7c201e736b1 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:15.746749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1963f18-025f-4ce0-ae25-52ade1e61180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:15.747628 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1963f18-025f-4ce0-ae25-52ade1e61180 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:15.747920 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1963f18-025f-4ce0-ae25-52ade1e61180 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:15.748197 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1963f18-025f-4ce0-ae25-52ade1e61180 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:15.763974 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1963f18-025f-4ce0-ae25-52ade1e61180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:15.765000 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd76cca-b1e6-46c4-86ec-0fb5f2776e1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:15.767483 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd76cca-b1e6-46c4-86ec-0fb5f2776e1e None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:15.772744 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:15.774059 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-f1963f18-025f-4ce0-ae25-52ade1e61180 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:03:15.774059 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:15.774059 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:15.774059 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:15.774059 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:15.774059 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:15.774059 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:15.774059 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:15.774059 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:15.774059 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:15.774059 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:15.774059 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:15.774059 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:15.774059 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:15.774059 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:15.774059 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:15.775069 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:15.775069 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:15.775069 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:15.775069 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:15.775069 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:15.775069 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:15.775069 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:15.775069 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:15.775069 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:15.775069 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:15.775069 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:15.775069 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:15.775069 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:15.775069 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:15.775069 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:15.775069 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:15.775865 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:15.775865 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:15.775865 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:15.775865 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:15.775865 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:15.775865 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:15.775865 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:15.775865 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:15.775865 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:15.775865 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:15.775865 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:03:15.775865 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:15.781490 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 182/367] 10.222.0.39 () {56 vars in 1096 bytes} [Wed May 25 15:03:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:15.783686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1963f18-025f-4ce0-ae25-52ade1e61180 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:15.844530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:15.901685 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1963f18-025f-4ce0-ae25-52ade1e61180 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:15.940545 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 186/368] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:03:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:03:15.940545 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd76cca-b1e6-46c4-86ec-0fb5f2776e1e None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:15.945465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be6172-267e-4723-865f-a2a8c181f244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:15.946343 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be6172-267e-4723-865f-a2a8c181f244 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:15.946771 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be6172-267e-4723-865f-a2a8c181f244 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:15.947208 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be6172-267e-4723-865f-a2a8c181f244 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:16.024990 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be6172-267e-4723-865f-a2a8c181f244 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:16.026844 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be6172-267e-4723-865f-a2a8c181f244 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:16.060129 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd76cca-b1e6-46c4-86ec-0fb5f2776e1e None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:16.062653 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:16.081051 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:16.100645 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e379fb-ca4a-4426-8634-6fb7e38db6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:16.101240 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e379fb-ca4a-4426-8634-6fb7e38db6d4 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:16.101518 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e379fb-ca4a-4426-8634-6fb7e38db6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:16.101872 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e379fb-ca4a-4426-8634-6fb7e38db6d4 None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:16.102556 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e379fb-ca4a-4426-8634-6fb7e38db6d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:16.102866 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e379fb-ca4a-4426-8634-6fb7e38db6d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:16.104234 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e379fb-ca4a-4426-8634-6fb7e38db6d4 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:16.114066 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 187/369] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:16.115113 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e379fb-ca4a-4426-8634-6fb7e38db6d4 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:16.142930 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 183/370] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:03:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:03:16.142930 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be6172-267e-4723-865f-a2a8c181f244 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:16.271332 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be6172-267e-4723-865f-a2a8c181f244 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:16.294641 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e379fb-ca4a-4426-8634-6fb7e38db6d4 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:16.324760 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d19f8-4485-4ba5-afbc-176435ab0623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:16.325436 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d19f8-4485-4ba5-afbc-176435ab0623 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:16.325720 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d19f8-4485-4ba5-afbc-176435ab0623 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:16.325998 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d19f8-4485-4ba5-afbc-176435ab0623 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:16.349615 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcc308-8c26-48e4-b86f-7f478cb516be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:16.350165 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:16.351393 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcc308-8c26-48e4-b86f-7f478cb516be None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:16.352000 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcc308-8c26-48e4-b86f-7f478cb516be None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:16.352458 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcc308-8c26-48e4-b86f-7f478cb516be None admin] PATH_INFO: `/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:16.353844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcc308-8c26-48e4-b86f-7f478cb516be None admin] RBAC: Authorizing `identity:get_project(project_id=5ffc3171df904ff0a47f7fb65d9090cb)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:16.355620 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcc308-8c26-48e4-b86f-7f478cb516be None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:16.357657 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 188/371] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:03:16 2022] GET /identity/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:16.358680 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcc308-8c26-48e4-b86f-7f478cb516be None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:16.410042 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:16.417243 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d19f8-4485-4ba5-afbc-176435ab0623 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:16.418787 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d19f8-4485-4ba5-afbc-176435ab0623 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:16.503327 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcc308-8c26-48e4-b86f-7f478cb516be None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:16.545047 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 184/372] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:03:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:03:16.545782 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d19f8-4485-4ba5-afbc-176435ab0623 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:16.547417 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323a314-b466-481a-a86e-95550781b912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:16.548303 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323a314-b466-481a-a86e-95550781b912 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:16.548685 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323a314-b466-481a-a86e-95550781b912 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:16.548962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323a314-b466-481a-a86e-95550781b912 None admin] PATH_INFO: `/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:16.550546 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323a314-b466-481a-a86e-95550781b912 None admin] RBAC: Authorizing `identity:get_project(project_id=5ffc3171df904ff0a47f7fb65d9090cb)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:16.552011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323a314-b466-481a-a86e-95550781b912 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:16.553974 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 189/373] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:03:16 2022] GET /identity/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:16.554910 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323a314-b466-481a-a86e-95550781b912 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:16.611075 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:16.677279 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323a314-b466-481a-a86e-95550781b912 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:16.679239 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:16.685714 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d19f8-4485-4ba5-afbc-176435ab0623 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:16.724691 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b06e7-3673-47b8-ac58-f0c8ad86fe07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:16.725853 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b06e7-3673-47b8-ac58-f0c8ad86fe07 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:16.726137 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b06e7-3673-47b8-ac58-f0c8ad86fe07 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:16.726432 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b06e7-3673-47b8-ac58-f0c8ad86fe07 None admin] PATH_INFO: `/v3/projects/91ba3df395e34a04b262fcb06d12fb3a` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:16.727964 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b06e7-3673-47b8-ac58-f0c8ad86fe07 None admin] RBAC: Authorizing `identity:get_project(project_id=91ba3df395e34a04b262fcb06d12fb3a)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:16.729401 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c02b49-4d70-4546-bb00-6be102fa59b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:16.729600 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b06e7-3673-47b8-ac58-f0c8ad86fe07 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:16.730309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c02b49-4d70-4546-bb00-6be102fa59b6 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:16.730591 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c02b49-4d70-4546-bb00-6be102fa59b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:16.730860 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c02b49-4d70-4546-bb00-6be102fa59b6 None admin] PATH_INFO: `/v3/groups/726c639c29bc4a158e57e8f7d607d233` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:16.731694 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 190/374] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:03:16 2022] GET /identity/v3/projects/91ba3df395e34a04b262fcb06d12fb3a => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:16.732047 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c02b49-4d70-4546-bb00-6be102fa59b6 None admin] RBAC: Authorizing `identity:get_group(group_id=726c639c29bc4a158e57e8f7d607d233)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:16.732488 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b06e7-3673-47b8-ac58-f0c8ad86fe07 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:16.733550 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c02b49-4d70-4546-bb00-6be102fa59b6 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:16.737774 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 185/375] 10.222.0.39 () {56 vars in 1180 bytes} [Wed May 25 15:03:16 2022] GET /identity/v3/groups/726c639c29bc4a158e57e8f7d607d233 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:16.738744 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c02b49-4d70-4546-bb00-6be102fa59b6 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:16.861701 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c02b49-4d70-4546-bb00-6be102fa59b6 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:16.867683 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b06e7-3673-47b8-ac58-f0c8ad86fe07 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:16.881546 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:16.905244 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6da22-5a74-4867-8802-ff4ee0cca4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:16.906701 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6da22-5a74-4867-8802-ff4ee0cca4af None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:16.906985 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6da22-5a74-4867-8802-ff4ee0cca4af None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:16.907271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6da22-5a74-4867-8802-ff4ee0cca4af None admin] PATH_INFO: `/v3/groups/ee3703df9f3d4d61951cdb21db7a9413` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:16.910291 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595c228-a766-4dd8-a82a-f4958d620f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:16.911469 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595c228-a766-4dd8-a82a-f4958d620f7b None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:16.911930 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595c228-a766-4dd8-a82a-f4958d620f7b None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:16.912401 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595c228-a766-4dd8-a82a-f4958d620f7b None admin] PATH_INFO: `/v3/groups/726c639c29bc4a158e57e8f7d607d233` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:16.914083 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595c228-a766-4dd8-a82a-f4958d620f7b None admin] RBAC: Authorizing `identity:get_group(group_id=726c639c29bc4a158e57e8f7d607d233)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:16.914519 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6da22-5a74-4867-8802-ff4ee0cca4af None admin] RBAC: Authorizing `identity:get_group(group_id=ee3703df9f3d4d61951cdb21db7a9413)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:16.915993 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595c228-a766-4dd8-a82a-f4958d620f7b None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:16.916102 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6da22-5a74-4867-8802-ff4ee0cca4af None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:16.917834 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 186/376] 10.222.0.39 () {56 vars in 1180 bytes} [Wed May 25 15:03:16 2022] GET /identity/v3/groups/ee3703df9f3d4d61951cdb21db7a9413 => generated 229 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:16.918135 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 191/377] 10.222.0.39 () {56 vars in 1180 bytes} [Wed May 25 15:03:16 2022] GET /identity/v3/groups/726c639c29bc4a158e57e8f7d607d233 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:16.921326 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6da22-5a74-4867-8802-ff4ee0cca4af None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:16.925557 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595c228-a766-4dd8-a82a-f4958d620f7b None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:16.988557 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:17.031755 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6da22-5a74-4867-8802-ff4ee0cca4af None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:17.073553 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595c228-a766-4dd8-a82a-f4958d620f7b None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:17.075763 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba82002-ff52-4c7e-aae8-66f00310fd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:17.076543 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba82002-ff52-4c7e-aae8-66f00310fd52 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:17.076823 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba82002-ff52-4c7e-aae8-66f00310fd52 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:17.077097 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba82002-ff52-4c7e-aae8-66f00310fd52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:17.078032 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba82002-ff52-4c7e-aae8-66f00310fd52 None admin] RBAC: Adding query filter params (group.id=726c639c29bc4a158e57e8f7d607d233, role.id=3ddf578e07094ecd820c44387851dbb8, scope.project.id=5ffc3171df904ff0a47f7fb65d9090cb) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:17.078560 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba82002-ff52-4c7e-aae8-66f00310fd52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:17.080054 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba82002-ff52-4c7e-aae8-66f00310fd52 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:17.089879 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 187/378] 10.222.0.39 () {56 vars in 1376 bytes} [Wed May 25 15:03:16 2022] GET /identity/v3/role_assignments?group.id=726c639c29bc4a158e57e8f7d607d233&scope.project.id=5ffc3171df904ff0a47f7fb65d9090cb&role.id=3ddf578e07094ecd820c44387851dbb8 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:17.090823 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba82002-ff52-4c7e-aae8-66f00310fd52 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:17.128719 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c6beb-2131-4247-99a4-92baca6b45f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:17.129340 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c6beb-2131-4247-99a4-92baca6b45f5 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:17.129617 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c6beb-2131-4247-99a4-92baca6b45f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:17.129904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c6beb-2131-4247-99a4-92baca6b45f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:17.130825 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c6beb-2131-4247-99a4-92baca6b45f5 None admin] RBAC: Adding query filter params (group.id=726c639c29bc4a158e57e8f7d607d233, role.id=44e6a84e85f84d5ba38f6ee215622918, scope.project.id=5ffc3171df904ff0a47f7fb65d9090cb) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:17.131190 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c6beb-2131-4247-99a4-92baca6b45f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:17.132678 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c6beb-2131-4247-99a4-92baca6b45f5 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:17.140293 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 192/379] 10.222.0.39 () {56 vars in 1376 bytes} [Wed May 25 15:03:16 2022] GET /identity/v3/role_assignments?group.id=726c639c29bc4a158e57e8f7d607d233&scope.project.id=5ffc3171df904ff0a47f7fb65d9090cb&role.id=44e6a84e85f84d5ba38f6ee215622918 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:17.142761 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b7912-0bad-4e82-b938-5892de5d6414 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:17.143049 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b7912-0bad-4e82-b938-5892de5d6414 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:17.143324 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b7912-0bad-4e82-b938-5892de5d6414 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:17.145193 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 193/380] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:17.150835 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d56292-adaa-49be-9c49-e773a0fbd5f2 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:17.151238 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d56292-adaa-49be-9c49-e773a0fbd5f2 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:17.151611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d56292-adaa-49be-9c49-e773a0fbd5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:17.159728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:17.184478 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-02d56292-adaa-49be-9c49-e773a0fbd5f2 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:17.185698 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-02d56292-adaa-49be-9c49-e773a0fbd5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:17.228700 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba82002-ff52-4c7e-aae8-66f00310fd52 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:17.270037 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 194/381] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:03:17.275959 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959e38a-b91e-442e-b7c6-4c9e819fc3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:17.276658 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959e38a-b91e-442e-b7c6-4c9e819fc3a5 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:17.276947 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959e38a-b91e-442e-b7c6-4c9e819fc3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:17.277231 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959e38a-b91e-442e-b7c6-4c9e819fc3a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:17.278082 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959e38a-b91e-442e-b7c6-4c9e819fc3a5 None admin] RBAC: Adding query filter params (group.id=ee3703df9f3d4d61951cdb21db7a9413, role.id=ff521c95c8aa454ea3daa6bc36d055b1, scope.project.id=91ba3df395e34a04b262fcb06d12fb3a) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:17.278456 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959e38a-b91e-442e-b7c6-4c9e819fc3a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:17.279887 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959e38a-b91e-442e-b7c6-4c9e819fc3a5 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:17.290394 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 188/382] 10.222.0.39 () {56 vars in 1376 bytes} [Wed May 25 15:03:17 2022] GET /identity/v3/role_assignments?group.id=ee3703df9f3d4d61951cdb21db7a9413&scope.project.id=91ba3df395e34a04b262fcb06d12fb3a&role.id=ff521c95c8aa454ea3daa6bc36d055b1 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:17.315968 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d56292-adaa-49be-9c49-e773a0fbd5f2 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:17.358996 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:17.478226 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d56292-adaa-49be-9c49-e773a0fbd5f2 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:17.522308 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886db73a-4db7-44ab-a9e7-c632626b8a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:17.523149 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886db73a-4db7-44ab-a9e7-c632626b8a7b None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:17.523429 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886db73a-4db7-44ab-a9e7-c632626b8a7b None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:17.523701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886db73a-4db7-44ab-a9e7-c632626b8a7b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:17.536511 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886db73a-4db7-44ab-a9e7-c632626b8a7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:17.544803 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-886db73a-4db7-44ab-a9e7-c632626b8a7b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:03:17.544803 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:17.544803 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:17.544803 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:17.544803 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:17.544803 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:17.544803 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:17.544803 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:17.544803 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:17.544803 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:17.544803 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:17.544803 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:17.544803 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:17.544803 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:17.544803 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:17.544803 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:17.545764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:17.545764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:17.545764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:17.545764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:17.545764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:17.545764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:17.545764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:17.545764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:17.545764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:17.545764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:17.545764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:17.545764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:17.545764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:17.545764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:17.545764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:17.545764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:17.546595 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:17.546595 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:17.546595 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:17.546595 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:17.546595 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:17.546595 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:17.546595 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:17.546595 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:17.546595 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:17.546595 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:17.546595 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:03:17.546595 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:17.546595 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 195/383] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:17.553002 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959e38a-b91e-442e-b7c6-4c9e819fc3a5 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:17.705978 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959e38a-b91e-442e-b7c6-4c9e819fc3a5 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:17.722272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:17.746277 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920aa24-4fcb-4810-9fdb-873628b3d7e4 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:17.746590 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920aa24-4fcb-4810-9fdb-873628b3d7e4 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:17.746842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920aa24-4fcb-4810-9fdb-873628b3d7e4 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:17.748506 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 196/384] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:17.753602 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42087da-2bf1-43ce-8ae3-fb3144174c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:17.754680 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42087da-2bf1-43ce-8ae3-fb3144174c7f None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:17.755184 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42087da-2bf1-43ce-8ae3-fb3144174c7f None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:17.755662 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42087da-2bf1-43ce-8ae3-fb3144174c7f None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:17.756630 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42087da-2bf1-43ce-8ae3-fb3144174c7f None admin] RBAC: Adding query filter params (name=member) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:17.757138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42087da-2bf1-43ce-8ae3-fb3144174c7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:17.758752 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42087da-2bf1-43ce-8ae3-fb3144174c7f None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:17.771948 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 189/385] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:03:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:17.773579 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2878e-7aa8-4225-b212-29b526508b6f None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:17.773878 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2878e-7aa8-4225-b212-29b526508b6f None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:17.774157 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2878e-7aa8-4225-b212-29b526508b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:17.775463 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42087da-2bf1-43ce-8ae3-fb3144174c7f None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:17.806847 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-7db2878e-7aa8-4225-b212-29b526508b6f None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:17.808119 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-7db2878e-7aa8-4225-b212-29b526508b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:17.885949 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42087da-2bf1-43ce-8ae3-fb3144174c7f None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:17.936135 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2cec2-badd-4bad-b4a2-8ff65757fce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:17.937796 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2cec2-badd-4bad-b4a2-8ff65757fce2 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:17.938355 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2cec2-badd-4bad-b4a2-8ff65757fce2 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:17.938833 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2cec2-badd-4bad-b4a2-8ff65757fce2 None admin] PATH_INFO: `/v3/groups/726c639c29bc4a158e57e8f7d607d233` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:17.941513 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2cec2-badd-4bad-b4a2-8ff65757fce2 None admin] RBAC: Authorizing `identity:get_group(group_id=726c639c29bc4a158e57e8f7d607d233)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:17.943246 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2cec2-badd-4bad-b4a2-8ff65757fce2 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:17.945137 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 190/386] 10.222.0.39 () {56 vars in 1180 bytes} [Wed May 25 15:03:17 2022] GET /identity/v3/groups/726c639c29bc4a158e57e8f7d607d233 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:17.950930 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2cec2-badd-4bad-b4a2-8ff65757fce2 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:17.967326 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 197/387] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:18.019927 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:18.045050 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2878e-7aa8-4225-b212-29b526508b6f None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:18.076993 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:18.109072 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2cec2-badd-4bad-b4a2-8ff65757fce2 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:18.161808 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2136da-977a-4c5f-9959-532b0326d730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:18.163120 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2136da-977a-4c5f-9959-532b0326d730 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:18.163633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2136da-977a-4c5f-9959-532b0326d730 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:18.164105 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2136da-977a-4c5f-9959-532b0326d730 None admin] PATH_INFO: `/v3/projects/d8426986884141db8d183e5b9a859a3b` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:18.166829 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2136da-977a-4c5f-9959-532b0326d730 None admin] RBAC: Authorizing `identity:get_project(project_id=d8426986884141db8d183e5b9a859a3b)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:18.168627 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2136da-977a-4c5f-9959-532b0326d730 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:18.173843 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 191/388] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:03:17 2022] GET /identity/v3/projects/d8426986884141db8d183e5b9a859a3b => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:18.178530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2136da-977a-4c5f-9959-532b0326d730 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:18.227834 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2878e-7aa8-4225-b212-29b526508b6f None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:18.300447 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655fb55-a45d-4f6c-a49a-7ed04f293cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:18.301652 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655fb55-a45d-4f6c-a49a-7ed04f293cac None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:18.302133 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655fb55-a45d-4f6c-a49a-7ed04f293cac None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:18.302642 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655fb55-a45d-4f6c-a49a-7ed04f293cac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:18.326497 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655fb55-a45d-4f6c-a49a-7ed04f293cac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:18.339137 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-0655fb55-a45d-4f6c-a49a-7ed04f293cac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:03:18.339137 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:18.339137 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:18.339137 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:18.339137 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:18.339137 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:18.339137 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:18.339137 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:18.339137 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:18.339137 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:18.339137 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:18.339137 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:18.339137 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:18.339137 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:18.339137 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:18.339137 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:18.340555 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:18.340555 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:18.340555 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:18.340555 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:18.340555 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:18.340555 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:18.340555 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:18.340555 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:18.340555 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:18.340555 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:18.340555 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:18.340555 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:18.340555 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:18.340555 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:18.340555 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:18.340555 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:18.341825 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:18.341825 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:18.341825 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:18.341825 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:18.341825 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:18.341825 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:18.341825 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:18.341825 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:18.341825 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:18.341825 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:18.341825 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:03:18.341825 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:18.341825 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 198/389] 10.222.0.39 () {56 vars in 1114 bytes} [Wed May 25 15:03:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:03:18.346736 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655fb55-a45d-4f6c-a49a-7ed04f293cac None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:18.376412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2136da-977a-4c5f-9959-532b0326d730 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:18.388011 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:18.485940 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abc085-bf9a-4890-8cb8-2ca1269a8f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:18.486172 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:18.487121 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abc085-bf9a-4890-8cb8-2ca1269a8f6f None admin] REQUEST_METHOD: `PUT` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:18.487474 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abc085-bf9a-4890-8cb8-2ca1269a8f6f None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:18.487899 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abc085-bf9a-4890-8cb8-2ca1269a8f6f None admin] PATH_INFO: `/v3/projects/d8426986884141db8d183e5b9a859a3b/groups/726c639c29bc4a158e57e8f7d607d233/roles/3ddf578e07094ecd820c44387851dbb8` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:18.494011 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abc085-bf9a-4890-8cb8-2ca1269a8f6f None admin] RBAC: Authorizing `identity:create_grant(project_id=d8426986884141db8d183e5b9a859a3b, group_id=726c639c29bc4a158e57e8f7d607d233, role_id=3ddf578e07094ecd820c44387851dbb8)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:18.494309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abc085-bf9a-4890-8cb8-2ca1269a8f6f None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:18.514826 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655fb55-a45d-4f6c-a49a-7ed04f293cac None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:18.524894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 192/390] 10.222.0.39 () {58 vars in 1442 bytes} [Wed May 25 15:03:18 2022] PUT /identity/v3/projects/d8426986884141db8d183e5b9a859a3b/groups/726c639c29bc4a158e57e8f7d607d233/roles/3ddf578e07094ecd820c44387851dbb8 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:18.566312 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19417d6-bd00-4528-80b1-43b3141f0131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:18.567524 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19417d6-bd00-4528-80b1-43b3141f0131 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:18.567944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19417d6-bd00-4528-80b1-43b3141f0131 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:18.568505 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19417d6-bd00-4528-80b1-43b3141f0131 None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:18.569501 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19417d6-bd00-4528-80b1-43b3141f0131 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:18.569952 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19417d6-bd00-4528-80b1-43b3141f0131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:18.571798 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19417d6-bd00-4528-80b1-43b3141f0131 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:18.585225 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 199/391] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:03:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:18.592284 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abc085-bf9a-4890-8cb8-2ca1269a8f6f None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:18.747401 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abc085-bf9a-4890-8cb8-2ca1269a8f6f None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:18.797258 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da46cc-0afc-489c-a440-845e32cb6dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:18.798143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da46cc-0afc-489c-a440-845e32cb6dc9 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:18.798462 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da46cc-0afc-489c-a440-845e32cb6dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:18.798771 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da46cc-0afc-489c-a440-845e32cb6dc9 None admin] PATH_INFO: `/v3/groups/726c639c29bc4a158e57e8f7d607d233` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:18.802989 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da46cc-0afc-489c-a440-845e32cb6dc9 None admin] RBAC: Authorizing `identity:get_group(group_id=726c639c29bc4a158e57e8f7d607d233)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:18.804457 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da46cc-0afc-489c-a440-845e32cb6dc9 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:18.806514 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 193/392] 10.222.0.39 () {56 vars in 1180 bytes} [Wed May 25 15:03:18 2022] GET /identity/v3/groups/726c639c29bc4a158e57e8f7d607d233 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:18.812224 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19417d6-bd00-4528-80b1-43b3141f0131 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:18.937019 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19417d6-bd00-4528-80b1-43b3141f0131 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:18.982405 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ca4a3-0da4-4bf3-9828-4d98f8ee23b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:18.983290 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ca4a3-0da4-4bf3-9828-4d98f8ee23b5 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:18.983624 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ca4a3-0da4-4bf3-9828-4d98f8ee23b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:18.983908 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ca4a3-0da4-4bf3-9828-4d98f8ee23b5 None admin] PATH_INFO: `/v3/projects/d8426986884141db8d183e5b9a859a3b` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:18.985234 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ca4a3-0da4-4bf3-9828-4d98f8ee23b5 None admin] RBAC: Authorizing `identity:get_project(project_id=d8426986884141db8d183e5b9a859a3b)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:18.986740 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ca4a3-0da4-4bf3-9828-4d98f8ee23b5 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:18.988891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 200/393] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:03:18 2022] GET /identity/v3/projects/d8426986884141db8d183e5b9a859a3b => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:18.994857 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da46cc-0afc-489c-a440-845e32cb6dc9 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:19.036718 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:19.105833 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da46cc-0afc-489c-a440-845e32cb6dc9 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:19.140972 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead6b79-7592-4ce6-9c1c-ad3b8cbbab04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:19.141884 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead6b79-7592-4ce6-9c1c-ad3b8cbbab04 None admin] REQUEST_METHOD: `PUT` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:19.142167 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead6b79-7592-4ce6-9c1c-ad3b8cbbab04 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:19.142482 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead6b79-7592-4ce6-9c1c-ad3b8cbbab04 None admin] PATH_INFO: `/v3/projects/d8426986884141db8d183e5b9a859a3b/groups/726c639c29bc4a158e57e8f7d607d233/roles/44e6a84e85f84d5ba38f6ee215622918` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:19.144752 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead6b79-7592-4ce6-9c1c-ad3b8cbbab04 None admin] RBAC: Authorizing `identity:create_grant(project_id=d8426986884141db8d183e5b9a859a3b, group_id=726c639c29bc4a158e57e8f7d607d233, role_id=44e6a84e85f84d5ba38f6ee215622918)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:19.146278 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead6b79-7592-4ce6-9c1c-ad3b8cbbab04 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:19.169990 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 194/394] 10.222.0.39 () {58 vars in 1442 bytes} [Wed May 25 15:03:18 2022] PUT /identity/v3/projects/d8426986884141db8d183e5b9a859a3b/groups/726c639c29bc4a158e57e8f7d607d233/roles/44e6a84e85f84d5ba38f6ee215622918 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:20.141792 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea16dee-a2dc-4530-8ed2-b7e8a9334d65 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:20.142376 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea16dee-a2dc-4530-8ed2-b7e8a9334d65 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:20.142376 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea16dee-a2dc-4530-8ed2-b7e8a9334d65 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:20.144062 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 201/395] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:20.149514 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba7113-fe2c-4e5b-8876-dd8f79dfab11 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:20.149933 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba7113-fe2c-4e5b-8876-dd8f79dfab11 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:20.150140 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba7113-fe2c-4e5b-8876-dd8f79dfab11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:20.167624 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-93ba7113-fe2c-4e5b-8876-dd8f79dfab11 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:20.168837 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-93ba7113-fe2c-4e5b-8876-dd8f79dfab11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:20.250350 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 195/396] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:20.267366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea16dee-a2dc-4530-8ed2-b7e8a9334d65 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:20.285643 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:20.380921 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea16dee-a2dc-4530-8ed2-b7e8a9334d65 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:20.410759 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9127fb-4e41-48f9-a948-c3e8d1b60db7 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:20.411040 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9127fb-4e41-48f9-a948-c3e8d1b60db7 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:20.411255 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9127fb-4e41-48f9-a948-c3e8d1b60db7 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:20.417326 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 196/397] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:03:20.419056 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02fe9e-5509-4d62-8126-8610d44a4ee6 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:20.419352 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02fe9e-5509-4d62-8126-8610d44a4ee6 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:20.419640 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02fe9e-5509-4d62-8126-8610d44a4ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:20.426983 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37443d3-34ac-483d-ad13-87acaa99b117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:20.427809 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37443d3-34ac-483d-ad13-87acaa99b117 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:20.428099 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37443d3-34ac-483d-ad13-87acaa99b117 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:20.428382 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37443d3-34ac-483d-ad13-87acaa99b117 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:20.445754 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37443d3-34ac-483d-ad13-87acaa99b117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:20.451517 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-9f02fe9e-5509-4d62-8126-8610d44a4ee6 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:20.455302 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-9f02fe9e-5509-4d62-8126-8610d44a4ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:20.455450 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-f37443d3-34ac-483d-ad13-87acaa99b117 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:03:20.455450 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:20.455450 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:20.455450 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:20.455450 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:20.455450 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:20.455450 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:20.455450 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:20.455450 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:20.455450 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:20.455450 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:20.455450 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:20.455450 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:20.455450 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:20.455450 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:20.455450 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:20.456487 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:20.456487 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:20.456487 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:20.456487 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:20.456487 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:20.456487 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:20.456487 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:20.456487 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:20.456487 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:20.456487 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:20.456487 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:20.456487 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:20.456487 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:20.456487 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:20.456487 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:20.456487 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:20.457359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:20.457359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:20.457359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:20.457359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:20.457359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:20.457359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:20.457359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:20.457359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:20.457359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:20.457359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:20.457359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:03:20.457359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:20.457359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 202/398] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:20.462269 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37443d3-34ac-483d-ad13-87acaa99b117 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:20.511738 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:20.562865 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:20.583052 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37443d3-34ac-483d-ad13-87acaa99b117 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:20.603312 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 197/399] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:20.604739 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2b08d-8f01-4769-9864-9dc9670a3762 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:20.605041 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2b08d-8f01-4769-9864-9dc9670a3762 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:20.605320 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2b08d-8f01-4769-9864-9dc9670a3762 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:20.606877 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 198/400] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:20.614189 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317547b8-d99f-41dd-a6e4-f8e40a44acbb None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:20.614741 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317547b8-d99f-41dd-a6e4-f8e40a44acbb None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:20.615157 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317547b8-d99f-41dd-a6e4-f8e40a44acbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:20.640683 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-317547b8-d99f-41dd-a6e4-f8e40a44acbb None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:20.642651 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-317547b8-d99f-41dd-a6e4-f8e40a44acbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:20.644587 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87295c-a011-49fb-a7d8-57a07a886b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:20.645592 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87295c-a011-49fb-a7d8-57a07a886b14 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:20.645888 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87295c-a011-49fb-a7d8-57a07a886b14 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:20.646170 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87295c-a011-49fb-a7d8-57a07a886b14 None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:20.647874 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87295c-a011-49fb-a7d8-57a07a886b14 None admin] RBAC: Adding query filter params (name=member) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:20.648212 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87295c-a011-49fb-a7d8-57a07a886b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:20.649657 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87295c-a011-49fb-a7d8-57a07a886b14 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:20.665014 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 203/401] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:03:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:20.665014 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87295c-a011-49fb-a7d8-57a07a886b14 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:20.747103 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 199/402] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:20.748298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317547b8-d99f-41dd-a6e4-f8e40a44acbb None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:20.797189 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87295c-a011-49fb-a7d8-57a07a886b14 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:20.838448 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142df282-03c0-4b23-b3fe-c41b0ec0c4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:20.840631 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142df282-03c0-4b23-b3fe-c41b0ec0c4dc None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:20.841328 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142df282-03c0-4b23-b3fe-c41b0ec0c4dc None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:20.841975 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142df282-03c0-4b23-b3fe-c41b0ec0c4dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:20.844684 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:20.856772 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:20.859663 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142df282-03c0-4b23-b3fe-c41b0ec0c4dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:20.872625 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-142df282-03c0-4b23-b3fe-c41b0ec0c4dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:03:20.872625 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:20.872625 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:20.872625 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:20.872625 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:20.872625 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:20.872625 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:20.872625 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:20.872625 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:20.872625 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:20.872625 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:20.872625 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:20.872625 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:20.872625 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:20.872625 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:20.872625 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:20.873753 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:20.873753 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:20.873753 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:20.873753 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:20.873753 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:20.873753 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:20.873753 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:20.873753 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:20.873753 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:20.873753 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:20.873753 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:20.873753 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:20.873753 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:20.873753 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:20.873753 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:20.873753 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:20.874764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:20.874764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:20.874764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:20.874764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:20.874764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:20.874764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:20.874764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:20.874764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:20.874764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:20.874764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:20.874764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:03:20.874764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:20.882204 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317547b8-d99f-41dd-a6e4-f8e40a44acbb None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:20.882452 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 204/403] 10.222.0.39 () {56 vars in 1114 bytes} [Wed May 25 15:03:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:20.884526 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142df282-03c0-4b23-b3fe-c41b0ec0c4dc None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:20.925283 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd74ef-ba32-4236-86b9-745a4c72acd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:20.926231 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd74ef-ba32-4236-86b9-745a4c72acd0 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:20.926677 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd74ef-ba32-4236-86b9-745a4c72acd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:20.927055 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd74ef-ba32-4236-86b9-745a4c72acd0 None admin] PATH_INFO: `/v3/groups/726c639c29bc4a158e57e8f7d607d233` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:20.928597 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd74ef-ba32-4236-86b9-745a4c72acd0 None admin] RBAC: Authorizing `identity:get_group(group_id=726c639c29bc4a158e57e8f7d607d233)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:20.930283 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd74ef-ba32-4236-86b9-745a4c72acd0 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:20.932405 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 200/404] 10.222.0.39 () {56 vars in 1180 bytes} [Wed May 25 15:03:20 2022] GET /identity/v3/groups/726c639c29bc4a158e57e8f7d607d233 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:20.933329 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd74ef-ba32-4236-86b9-745a4c72acd0 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:21.019838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142df282-03c0-4b23-b3fe-c41b0ec0c4dc None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:21.048863 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd74ef-ba32-4236-86b9-745a4c72acd0 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:21.066703 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca6850-cc9c-4d3b-84f3-3660ef07a4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:21.068043 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca6850-cc9c-4d3b-84f3-3660ef07a4a7 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:21.068472 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca6850-cc9c-4d3b-84f3-3660ef07a4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:21.069162 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca6850-cc9c-4d3b-84f3-3660ef07a4a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:21.083850 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca6850-cc9c-4d3b-84f3-3660ef07a4a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:21.087825 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e09ca8-aa98-4d98-89c4-22f036ac1515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:21.088658 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e09ca8-aa98-4d98-89c4-22f036ac1515 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:21.089037 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e09ca8-aa98-4d98-89c4-22f036ac1515 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:21.089408 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e09ca8-aa98-4d98-89c4-22f036ac1515 None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:21.090264 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e09ca8-aa98-4d98-89c4-22f036ac1515 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:21.090685 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e09ca8-aa98-4d98-89c4-22f036ac1515 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:21.092151 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e09ca8-aa98-4d98-89c4-22f036ac1515 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:21.093127 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-a6ca6850-cc9c-4d3b-84f3-3660ef07a4a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:03:21.093127 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:21.093127 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:21.093127 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:21.093127 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:21.093127 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:21.093127 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:21.093127 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:21.093127 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:21.093127 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:21.093127 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:21.093127 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:21.093127 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:21.093127 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:21.093127 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:21.093127 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:21.094215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:21.094215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:21.094215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:21.094215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:21.094215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:21.094215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:21.094215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:21.094215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:21.094215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:21.094215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:21.094215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:21.094215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:21.094215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:21.094215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:21.094215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:21.094215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:21.095282 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:21.095282 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:21.095282 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:21.095282 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:21.095282 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:21.095282 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:21.095282 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:21.095282 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:21.095282 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:21.095282 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:21.095282 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:03:21.095282 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:21.097906 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 205/405] 10.222.0.39 () {56 vars in 1096 bytes} [Wed May 25 15:03:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:21.099046 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca6850-cc9c-4d3b-84f3-3660ef07a4a7 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:21.115267 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 201/406] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:03:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:21.115267 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e09ca8-aa98-4d98-89c4-22f036ac1515 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:21.136331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:21.183073 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:21.229751 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e09ca8-aa98-4d98-89c4-22f036ac1515 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:21.251574 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca6850-cc9c-4d3b-84f3-3660ef07a4a7 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:21.265954 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bf74d-80c7-4a3b-9026-a2dcfe1cb63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:21.266828 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bf74d-80c7-4a3b-9026-a2dcfe1cb63a None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:21.267285 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bf74d-80c7-4a3b-9026-a2dcfe1cb63a None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:21.267642 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0bf74d-80c7-4a3b-9026-a2dcfe1cb63a None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:21.268516 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0bf74d-80c7-4a3b-9026-a2dcfe1cb63a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:21.268922 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0bf74d-80c7-4a3b-9026-a2dcfe1cb63a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:21.270442 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0bf74d-80c7-4a3b-9026-a2dcfe1cb63a None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:21.285013 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 202/407] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:21.286929 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bf74d-80c7-4a3b-9026-a2dcfe1cb63a None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:21.298411 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d818634-265b-401e-9899-5246a189fa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:21.299574 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d818634-265b-401e-9899-5246a189fa30 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:21.299979 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d818634-265b-401e-9899-5246a189fa30 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:21.300971 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d818634-265b-401e-9899-5246a189fa30 None admin] PATH_INFO: `/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:21.302102 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d818634-265b-401e-9899-5246a189fa30 None admin] RBAC: Authorizing `identity:get_project(project_id=5ffc3171df904ff0a47f7fb65d9090cb)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:21.304616 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d818634-265b-401e-9899-5246a189fa30 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:21.308515 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 206/408] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:03:21 2022] GET /identity/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:21.309551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d818634-265b-401e-9899-5246a189fa30 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:21.396303 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:21.417883 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d818634-265b-401e-9899-5246a189fa30 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:21.431384 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0bf74d-80c7-4a3b-9026-a2dcfe1cb63a None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:21.451432 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:21.473019 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001a201-884c-4b50-968d-7378b0d00736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:21.474444 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001a201-884c-4b50-968d-7378b0d00736 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:21.474950 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001a201-884c-4b50-968d-7378b0d00736 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:21.475434 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001a201-884c-4b50-968d-7378b0d00736 None admin] PATH_INFO: `/v3/groups/ee3703df9f3d4d61951cdb21db7a9413` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:21.476957 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001a201-884c-4b50-968d-7378b0d00736 None admin] RBAC: Authorizing `identity:get_group(group_id=ee3703df9f3d4d61951cdb21db7a9413)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:21.478655 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001a201-884c-4b50-968d-7378b0d00736 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:21.478994 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe4b52-1e35-4fb2-8c52-9d4f7545e64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:21.479976 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe4b52-1e35-4fb2-8c52-9d4f7545e64a None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:21.480272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe4b52-1e35-4fb2-8c52-9d4f7545e64a None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:21.480551 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe4b52-1e35-4fb2-8c52-9d4f7545e64a None admin] PATH_INFO: `/v3/groups/726c639c29bc4a158e57e8f7d607d233` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:21.481458 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 207/409] 10.222.0.39 () {56 vars in 1180 bytes} [Wed May 25 15:03:21 2022] GET /identity/v3/groups/ee3703df9f3d4d61951cdb21db7a9413 => generated 229 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:21.481735 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe4b52-1e35-4fb2-8c52-9d4f7545e64a None admin] RBAC: Authorizing `identity:get_group(group_id=726c639c29bc4a158e57e8f7d607d233)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:21.482698 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001a201-884c-4b50-968d-7378b0d00736 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:21.486353 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe4b52-1e35-4fb2-8c52-9d4f7545e64a None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:21.488564 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 203/410] 10.222.0.39 () {56 vars in 1180 bytes} [Wed May 25 15:03:21 2022] GET /identity/v3/groups/726c639c29bc4a158e57e8f7d607d233 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:21.492945 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe4b52-1e35-4fb2-8c52-9d4f7545e64a None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:21.602994 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe4b52-1e35-4fb2-8c52-9d4f7545e64a None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:21.612702 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001a201-884c-4b50-968d-7378b0d00736 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:21.638390 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca90df-4694-4a5b-b895-425762800665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:21.639499 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca90df-4694-4a5b-b895-425762800665 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:21.639785 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca90df-4694-4a5b-b895-425762800665 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:21.640065 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca90df-4694-4a5b-b895-425762800665 None admin] PATH_INFO: `/v3/projects/91ba3df395e34a04b262fcb06d12fb3a` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:21.641447 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca90df-4694-4a5b-b895-425762800665 None admin] RBAC: Authorizing `identity:get_project(project_id=91ba3df395e34a04b262fcb06d12fb3a)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:21.642933 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca90df-4694-4a5b-b895-425762800665 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:21.644655 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 204/411] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:03:21 2022] GET /identity/v3/projects/91ba3df395e34a04b262fcb06d12fb3a => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:21.650497 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9beafb-0bcf-46fc-b4c7-6e4346736937 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:21.650788 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9beafb-0bcf-46fc-b4c7-6e4346736937 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:21.651074 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9beafb-0bcf-46fc-b4c7-6e4346736937 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:21.652350 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 205/412] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:21.652743 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239f6d1-d244-4255-9593-055604090f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:21.653047 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9beafb-0bcf-46fc-b4c7-6e4346736937 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:21.654146 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239f6d1-d244-4255-9593-055604090f0b None admin] REQUEST_METHOD: `PUT` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:21.654530 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239f6d1-d244-4255-9593-055604090f0b None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:21.654873 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239f6d1-d244-4255-9593-055604090f0b None admin] PATH_INFO: `/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb/groups/726c639c29bc4a158e57e8f7d607d233/roles/3ddf578e07094ecd820c44387851dbb8` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:21.658074 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239f6d1-d244-4255-9593-055604090f0b None admin] RBAC: Authorizing `identity:create_grant(project_id=5ffc3171df904ff0a47f7fb65d9090cb, group_id=726c639c29bc4a158e57e8f7d607d233, role_id=3ddf578e07094ecd820c44387851dbb8)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:21.659581 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239f6d1-d244-4255-9593-055604090f0b None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:21.674341 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:21.685489 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 208/413] 10.222.0.39 () {58 vars in 1442 bytes} [Wed May 25 15:03:21 2022] PUT /identity/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb/groups/726c639c29bc4a158e57e8f7d607d233/roles/3ddf578e07094ecd820c44387851dbb8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:21.685489 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239f6d1-d244-4255-9593-055604090f0b None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:21.746452 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:21.782897 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9beafb-0bcf-46fc-b4c7-6e4346736937 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:21.806811 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239f6d1-d244-4255-9593-055604090f0b None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:21.823034 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52357afe-c428-4838-b130-cbd5d960362b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:21.823939 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52357afe-c428-4838-b130-cbd5d960362b None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:21.824227 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52357afe-c428-4838-b130-cbd5d960362b None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:21.824636 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52357afe-c428-4838-b130-cbd5d960362b None admin] PATH_INFO: `/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:21.825973 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52357afe-c428-4838-b130-cbd5d960362b None admin] RBAC: Authorizing `identity:get_project(project_id=5ffc3171df904ff0a47f7fb65d9090cb)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:21.827590 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52357afe-c428-4838-b130-cbd5d960362b None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:21.834691 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 206/414] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:03:21 2022] GET /identity/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:21.836192 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684d1d4-0fe9-48d7-87fc-0d917dc08e82 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:21.836492 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684d1d4-0fe9-48d7-87fc-0d917dc08e82 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:21.836832 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684d1d4-0fe9-48d7-87fc-0d917dc08e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:21.846398 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b41212-8b59-4e7a-859c-2f7716392b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:21.847320 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b41212-8b59-4e7a-859c-2f7716392b2a None admin] REQUEST_METHOD: `PUT` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:21.847605 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b41212-8b59-4e7a-859c-2f7716392b2a None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:21.847883 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b41212-8b59-4e7a-859c-2f7716392b2a None admin] PATH_INFO: `/v3/projects/91ba3df395e34a04b262fcb06d12fb3a/groups/ee3703df9f3d4d61951cdb21db7a9413/roles/ff521c95c8aa454ea3daa6bc36d055b1` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:21.850021 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b41212-8b59-4e7a-859c-2f7716392b2a None admin] RBAC: Authorizing `identity:create_grant(project_id=91ba3df395e34a04b262fcb06d12fb3a, group_id=ee3703df9f3d4d61951cdb21db7a9413, role_id=ff521c95c8aa454ea3daa6bc36d055b1)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:21.851793 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b41212-8b59-4e7a-859c-2f7716392b2a None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:21.857067 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-2684d1d4-0fe9-48d7-87fc-0d917dc08e82 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:21.858487 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-2684d1d4-0fe9-48d7-87fc-0d917dc08e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:21.869781 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 209/415] 10.222.0.39 () {58 vars in 1442 bytes} [Wed May 25 15:03:21 2022] PUT /identity/v3/projects/91ba3df395e34a04b262fcb06d12fb3a/groups/ee3703df9f3d4d61951cdb21db7a9413/roles/ff521c95c8aa454ea3daa6bc36d055b1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:21.880414 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b41212-8b59-4e7a-859c-2f7716392b2a None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:21.946100 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 207/416] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:21.947892 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608e273-d392-42e0-b2b3-2ae076cf4c71 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:21.948344 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608e273-d392-42e0-b2b3-2ae076cf4c71 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:21.948749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608e273-d392-42e0-b2b3-2ae076cf4c71 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:21.950429 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 208/417] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:21.956047 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a772a-b956-47dd-a7a6-63cb31bb2418 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:21.956557 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a772a-b956-47dd-a7a6-63cb31bb2418 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:21.957025 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a772a-b956-47dd-a7a6-63cb31bb2418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:21.974663 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-c30a772a-b956-47dd-a7a6-63cb31bb2418 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:21.976229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-c30a772a-b956-47dd-a7a6-63cb31bb2418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:21.987656 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:22.018129 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b41212-8b59-4e7a-859c-2f7716392b2a None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:22.031048 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:22.059735 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f238ef-2a6b-42aa-be66-6c760306417b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:22.061607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f238ef-2a6b-42aa-be66-6c760306417b None admin] REQUEST_METHOD: `PUT` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:22.062499 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f238ef-2a6b-42aa-be66-6c760306417b None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:22.063129 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f238ef-2a6b-42aa-be66-6c760306417b None admin] PATH_INFO: `/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb/groups/726c639c29bc4a158e57e8f7d607d233/roles/44e6a84e85f84d5ba38f6ee215622918` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:22.068740 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f238ef-2a6b-42aa-be66-6c760306417b None admin] RBAC: Authorizing `identity:create_grant(project_id=5ffc3171df904ff0a47f7fb65d9090cb, group_id=726c639c29bc4a158e57e8f7d607d233, role_id=44e6a84e85f84d5ba38f6ee215622918)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:22.071089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f238ef-2a6b-42aa-be66-6c760306417b None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:22.082171 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 209/418] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:03:22.082171 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a772a-b956-47dd-a7a6-63cb31bb2418 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:22.101551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 210/419] 10.222.0.39 () {58 vars in 1442 bytes} [Wed May 25 15:03:21 2022] PUT /identity/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb/groups/726c639c29bc4a158e57e8f7d607d233/roles/44e6a84e85f84d5ba38f6ee215622918 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:22.113542 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f238ef-2a6b-42aa-be66-6c760306417b None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:22.274565 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f238ef-2a6b-42aa-be66-6c760306417b None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:22.294278 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a772a-b956-47dd-a7a6-63cb31bb2418 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:22.352257 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6c9fd-d63c-4e4f-8653-6105e2dd2b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:22.354014 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6c9fd-d63c-4e4f-8653-6105e2dd2b45 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:22.354828 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6c9fd-d63c-4e4f-8653-6105e2dd2b45 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:22.355594 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6c9fd-d63c-4e4f-8653-6105e2dd2b45 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:22.374747 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6c9fd-d63c-4e4f-8653-6105e2dd2b45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:22.379301 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25cff3d-c0d9-4335-aa40-c09a51d8488d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:22.380374 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cff3d-c0d9-4335-aa40-c09a51d8488d None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:22.380850 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cff3d-c0d9-4335-aa40-c09a51d8488d None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:22.381337 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cff3d-c0d9-4335-aa40-c09a51d8488d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:22.382981 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-85f6c9fd-d63c-4e4f-8653-6105e2dd2b45 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:03:22.382981 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:22.382981 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:22.382981 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:22.382981 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:22.382981 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:22.382981 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:22.382981 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:22.382981 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:22.382981 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:22.382981 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:22.382981 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:22.382981 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:22.382981 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:22.382981 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:22.382981 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:22.383836 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:22.383836 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:22.383836 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:22.383836 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:22.383836 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:22.383836 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:22.383836 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:22.383836 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:22.383836 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:22.383836 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:22.383836 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:22.383836 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:22.383836 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:22.383836 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:22.383836 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:22.383836 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:22.384628 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:22.384628 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:22.384628 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:22.384628 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:22.384628 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:22.384628 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:22.384628 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:22.384628 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:22.384628 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:22.384628 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:22.384628 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:03:22.384628 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:22.384628 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 211/420] 10.222.0.39 () {56 vars in 1114 bytes} [Wed May 25 15:03:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:22.390178 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6c9fd-d63c-4e4f-8653-6105e2dd2b45 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:22.395572 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:22.398976 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25cff3d-c0d9-4335-aa40-c09a51d8488d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:22.413688 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-b25cff3d-c0d9-4335-aa40-c09a51d8488d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:03:22.413688 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:22.413688 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:22.413688 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:22.413688 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:22.413688 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:22.413688 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:22.413688 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:22.413688 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:22.413688 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:22.413688 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:22.413688 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:22.413688 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:22.413688 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:22.413688 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:22.413688 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:22.414659 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:22.414659 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:22.414659 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:22.414659 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:22.414659 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:22.414659 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:22.414659 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:22.414659 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:22.414659 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:22.414659 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:22.414659 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:22.414659 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:22.414659 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:22.414659 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:22.414659 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:22.414659 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:22.415536 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:22.415536 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:22.415536 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:22.415536 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:22.415536 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:22.415536 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:22.415536 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:22.415536 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:22.415536 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:22.415536 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:22.415536 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:03:22.415536 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:22.418393 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 210/421] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:22.426910 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25cff3d-c0d9-4335-aa40-c09a51d8488d None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:22.450633 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:22.533856 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6c9fd-d63c-4e4f-8653-6105e2dd2b45 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:22.596685 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98b06a-0702-4d6b-8d69-f4fc7fe267b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:22.597375 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98b06a-0702-4d6b-8d69-f4fc7fe267b7 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:22.597670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98b06a-0702-4d6b-8d69-f4fc7fe267b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:22.598083 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98b06a-0702-4d6b-8d69-f4fc7fe267b7 None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:22.598939 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a98b06a-0702-4d6b-8d69-f4fc7fe267b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:22.599254 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a98b06a-0702-4d6b-8d69-f4fc7fe267b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:22.600653 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a98b06a-0702-4d6b-8d69-f4fc7fe267b7 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:22.601651 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25cff3d-c0d9-4335-aa40-c09a51d8488d None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:22.616937 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 212/422] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:03:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:22.623844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98b06a-0702-4d6b-8d69-f4fc7fe267b7 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:22.642569 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581570b-e831-4763-abed-e95140e4181c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:22.643251 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581570b-e831-4763-abed-e95140e4181c None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:22.643530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581570b-e831-4763-abed-e95140e4181c None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:22.643805 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581570b-e831-4763-abed-e95140e4181c None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:22.644552 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581570b-e831-4763-abed-e95140e4181c None admin] RBAC: Adding query filter params (name=member) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:22.644857 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581570b-e831-4763-abed-e95140e4181c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:22.650268 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581570b-e831-4763-abed-e95140e4181c None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:22.655443 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 211/423] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:03:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:22.661633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581570b-e831-4763-abed-e95140e4181c None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:22.779548 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:22.789729 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98b06a-0702-4d6b-8d69-f4fc7fe267b7 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:22.790166 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:22.831415 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6d93a-1f0e-4c23-822a-f77c719403e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:22.832070 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6d93a-1f0e-4c23-822a-f77c719403e9 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:22.832349 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6d93a-1f0e-4c23-822a-f77c719403e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:22.832625 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6d93a-1f0e-4c23-822a-f77c719403e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:22.883906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581570b-e831-4763-abed-e95140e4181c None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:22.955010 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6d93a-1f0e-4c23-822a-f77c719403e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:22.959973 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80355b1-fe42-420d-b18f-38edc0f8f0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:22.960703 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80355b1-fe42-420d-b18f-38edc0f8f0bf None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:22.960840 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6d93a-1f0e-4c23-822a-f77c719403e9 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:22.961118 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80355b1-fe42-420d-b18f-38edc0f8f0bf None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:22.961289 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80355b1-fe42-420d-b18f-38edc0f8f0bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:23.047931 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80355b1-fe42-420d-b18f-38edc0f8f0bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:23.049319 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80355b1-fe42-420d-b18f-38edc0f8f0bf None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:23.074992 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:23.093360 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 213/424] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:03:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:03:23.100224 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6d93a-1f0e-4c23-822a-f77c719403e9 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:23.120044 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:23.162608 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 212/425] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:03:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:03:23.168435 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80355b1-fe42-420d-b18f-38edc0f8f0bf None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:23.235531 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6d93a-1f0e-4c23-822a-f77c719403e9 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:23.272068 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1210e5-c379-43ea-97a2-f8e12902c29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:23.272937 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1210e5-c379-43ea-97a2-f8e12902c29e None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:23.273218 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1210e5-c379-43ea-97a2-f8e12902c29e None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:23.273491 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1210e5-c379-43ea-97a2-f8e12902c29e None admin] PATH_INFO: `/v3/projects/d8426986884141db8d183e5b9a859a3b` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:23.274723 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1210e5-c379-43ea-97a2-f8e12902c29e None admin] RBAC: Authorizing `identity:get_project(project_id=d8426986884141db8d183e5b9a859a3b)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:23.276159 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1210e5-c379-43ea-97a2-f8e12902c29e None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:23.278156 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 214/426] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:03:23 2022] GET /identity/v3/projects/d8426986884141db8d183e5b9a859a3b => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:23.287252 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1210e5-c379-43ea-97a2-f8e12902c29e None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:23.302594 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80355b1-fe42-420d-b18f-38edc0f8f0bf None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:23.348702 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81435410-62aa-4fb5-b285-9010a78a5ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:23.349601 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81435410-62aa-4fb5-b285-9010a78a5ff0 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:23.349878 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81435410-62aa-4fb5-b285-9010a78a5ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:23.350147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81435410-62aa-4fb5-b285-9010a78a5ff0 None admin] PATH_INFO: `/v3/projects/d8426986884141db8d183e5b9a859a3b` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:23.355143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81435410-62aa-4fb5-b285-9010a78a5ff0 None admin] RBAC: Authorizing `identity:get_project(project_id=d8426986884141db8d183e5b9a859a3b)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:23.356623 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81435410-62aa-4fb5-b285-9010a78a5ff0 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:23.358840 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 213/427] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:03:23 2022] GET /identity/v3/projects/d8426986884141db8d183e5b9a859a3b => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:23.364423 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81435410-62aa-4fb5-b285-9010a78a5ff0 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:23.382800 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:23.427116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1210e5-c379-43ea-97a2-f8e12902c29e None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:23.448312 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:23.470865 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2ec8a-d48b-4e3c-b27e-25a411f75dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:23.471922 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2ec8a-d48b-4e3c-b27e-25a411f75dd5 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:23.472304 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2ec8a-d48b-4e3c-b27e-25a411f75dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:23.472680 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2ec8a-d48b-4e3c-b27e-25a411f75dd5 None admin] PATH_INFO: `/v3/groups/726c639c29bc4a158e57e8f7d607d233` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:23.473978 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2ec8a-d48b-4e3c-b27e-25a411f75dd5 None admin] RBAC: Authorizing `identity:get_group(group_id=726c639c29bc4a158e57e8f7d607d233)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:23.477081 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2ec8a-d48b-4e3c-b27e-25a411f75dd5 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:23.479191 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 215/428] 10.222.0.39 () {56 vars in 1180 bytes} [Wed May 25 15:03:23 2022] GET /identity/v3/groups/726c639c29bc4a158e57e8f7d607d233 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:23.488325 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2ec8a-d48b-4e3c-b27e-25a411f75dd5 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:23.608051 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81435410-62aa-4fb5-b285-9010a78a5ff0 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:23.671576 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2ec8a-d48b-4e3c-b27e-25a411f75dd5 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:23.678875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93a0b0-af6a-46f3-b448-13ea7909ee53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:23.679762 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93a0b0-af6a-46f3-b448-13ea7909ee53 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:23.680050 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93a0b0-af6a-46f3-b448-13ea7909ee53 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:23.680331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93a0b0-af6a-46f3-b448-13ea7909ee53 None admin] PATH_INFO: `/v3/groups/726c639c29bc4a158e57e8f7d607d233` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:23.686545 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93a0b0-af6a-46f3-b448-13ea7909ee53 None admin] RBAC: Authorizing `identity:get_group(group_id=726c639c29bc4a158e57e8f7d607d233)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:23.688080 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec93a0b0-af6a-46f3-b448-13ea7909ee53 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:23.692474 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 214/429] 10.222.0.39 () {56 vars in 1180 bytes} [Wed May 25 15:03:23 2022] GET /identity/v3/groups/726c639c29bc4a158e57e8f7d607d233 => generated 226 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:23.696059 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93a0b0-af6a-46f3-b448-13ea7909ee53 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:23.729008 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:23.746168 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938f5bb-1695-40bb-b925-35cdad1f4e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:23.746860 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938f5bb-1695-40bb-b925-35cdad1f4e98 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:23.747245 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938f5bb-1695-40bb-b925-35cdad1f4e98 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:23.747527 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938f5bb-1695-40bb-b925-35cdad1f4e98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:23.748370 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938f5bb-1695-40bb-b925-35cdad1f4e98 None admin] RBAC: Adding query filter params (group.id=726c639c29bc4a158e57e8f7d607d233, role.id=44e6a84e85f84d5ba38f6ee215622918, scope.project.id=d8426986884141db8d183e5b9a859a3b) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:23.748684 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938f5bb-1695-40bb-b925-35cdad1f4e98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:23.750128 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938f5bb-1695-40bb-b925-35cdad1f4e98 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:23.757011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 216/430] 10.222.0.39 () {56 vars in 1376 bytes} [Wed May 25 15:03:23 2022] GET /identity/v3/role_assignments?group.id=726c639c29bc4a158e57e8f7d607d233&scope.project.id=d8426986884141db8d183e5b9a859a3b&role.id=44e6a84e85f84d5ba38f6ee215622918 => generated 611 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:23.886439 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:23.890270 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93a0b0-af6a-46f3-b448-13ea7909ee53 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:23.939742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3f228-23c4-43de-a9be-354b21cd0fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:23.940427 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3f228-23c4-43de-a9be-354b21cd0fef None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:23.940723 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3f228-23c4-43de-a9be-354b21cd0fef None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:23.941007 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3f228-23c4-43de-a9be-354b21cd0fef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:23.941845 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3f228-23c4-43de-a9be-354b21cd0fef None admin] RBAC: Adding query filter params (group.id=726c639c29bc4a158e57e8f7d607d233, role.id=3ddf578e07094ecd820c44387851dbb8, scope.project.id=d8426986884141db8d183e5b9a859a3b) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:23.942160 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3f228-23c4-43de-a9be-354b21cd0fef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:23.943674 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3f228-23c4-43de-a9be-354b21cd0fef None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:23.955080 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 215/431] 10.222.0.39 () {56 vars in 1376 bytes} [Wed May 25 15:03:23 2022] GET /identity/v3/role_assignments?group.id=726c639c29bc4a158e57e8f7d607d233&scope.project.id=d8426986884141db8d183e5b9a859a3b&role.id=3ddf578e07094ecd820c44387851dbb8 => generated 611 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:24.323828 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd244bd-912d-4758-95ea-1c8632200e9d None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:24.324348 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd244bd-912d-4758-95ea-1c8632200e9d None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:24.324348 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd244bd-912d-4758-95ea-1c8632200e9d None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:24.326144 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 217/432] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:24.332486 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba93c4c-468c-4119-a72b-4b998b9d769e None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:24.332963 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba93c4c-468c-4119-a72b-4b998b9d769e None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:24.333200 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba93c4c-468c-4119-a72b-4b998b9d769e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:24.351899 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-2ba93c4c-468c-4119-a72b-4b998b9d769e None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:24.353276 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-2ba93c4c-468c-4119-a72b-4b998b9d769e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:24.431304 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 216/433] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:24.456858 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd244bd-912d-4758-95ea-1c8632200e9d None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:24.581639 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd244bd-912d-4758-95ea-1c8632200e9d None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:24.624726 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8715a8-b6ba-4998-85f3-3e46d45e61af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:24.625587 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8715a8-b6ba-4998-85f3-3e46d45e61af None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:24.625868 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8715a8-b6ba-4998-85f3-3e46d45e61af None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:24.626187 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8715a8-b6ba-4998-85f3-3e46d45e61af None admin] PATH_INFO: `/v3/roles/member` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:24.637751 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8715a8-b6ba-4998-85f3-3e46d45e61af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:24.645958 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-fa8715a8-b6ba-4998-85f3-3e46d45e61af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:03:24.645958 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:24.645958 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:24.645958 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:24.645958 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:24.645958 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:24.645958 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:24.645958 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:24.645958 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:24.645958 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:24.645958 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:24.645958 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:24.645958 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:24.645958 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:24.645958 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:24.645958 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:24.646883 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:24.646883 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:24.646883 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:24.646883 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:24.646883 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:24.646883 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:24.646883 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:24.646883 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:24.646883 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:24.646883 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:24.646883 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:24.646883 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:24.646883 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:24.646883 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:24.646883 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:24.646883 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:24.647659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:24.647659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:24.647659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:24.647659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:24.647659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:24.647659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:24.647659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:24.647659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:24.647659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:24.647659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:24.647659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:03:24.647659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:24.647659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 218/434] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:24.654697 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba93c4c-468c-4119-a72b-4b998b9d769e None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:24.722930 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258dbd1-d244-4add-bd11-aba58b73ea7d None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:24.723270 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258dbd1-d244-4add-bd11-aba58b73ea7d None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:24.723549 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258dbd1-d244-4add-bd11-aba58b73ea7d None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:24.725826 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 219/435] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:24.730757 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de5a33-2dd4-448c-9320-9eec31e83448 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:24.731040 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de5a33-2dd4-448c-9320-9eec31e83448 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:24.731315 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de5a33-2dd4-448c-9320-9eec31e83448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:24.749015 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-06de5a33-2dd4-448c-9320-9eec31e83448 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:24.750303 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-06de5a33-2dd4-448c-9320-9eec31e83448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:24.758364 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:24.767779 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba93c4c-468c-4119-a72b-4b998b9d769e None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:24.802208 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea3e74-0f19-4f26-bf20-56811e1d9cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:24.802906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea3e74-0f19-4f26-bf20-56811e1d9cb0 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:24.803184 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea3e74-0f19-4f26-bf20-56811e1d9cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:24.803463 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea3e74-0f19-4f26-bf20-56811e1d9cb0 None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:24.803957 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:24.804199 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea3e74-0f19-4f26-bf20-56811e1d9cb0 None admin] RBAC: Adding query filter params (name=member) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:24.804505 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea3e74-0f19-4f26-bf20-56811e1d9cb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:24.805887 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea3e74-0f19-4f26-bf20-56811e1d9cb0 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:24.814758 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 217/436] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:03:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:24.816039 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e23d4-d7a9-4e3c-8a0d-4871573a7e9c None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:24.816326 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e23d4-d7a9-4e3c-8a0d-4871573a7e9c None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:24.816600 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e23d4-d7a9-4e3c-8a0d-4871573a7e9c None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:24.817799 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 218/437] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:24.820224 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e23d4-d7a9-4e3c-8a0d-4871573a7e9c None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:24.830861 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 220/438] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:03:24.832216 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5317be-2513-4ae7-91ba-7b5e9fc00b4c None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:24.832442 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5317be-2513-4ae7-91ba-7b5e9fc00b4c None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:24.832710 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5317be-2513-4ae7-91ba-7b5e9fc00b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:24.853106 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-cb5317be-2513-4ae7-91ba-7b5e9fc00b4c None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:24.854562 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-cb5317be-2513-4ae7-91ba-7b5e9fc00b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:24.923230 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 221/439] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:24.923698 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5317be-2513-4ae7-91ba-7b5e9fc00b4c None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:24.935152 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e23d4-d7a9-4e3c-8a0d-4871573a7e9c None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:24.969505 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea1a5c-3782-4f9b-b3ee-6da61012e191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:24.970280 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea1a5c-3782-4f9b-b3ee-6da61012e191 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:24.970572 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea1a5c-3782-4f9b-b3ee-6da61012e191 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:24.970849 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea1a5c-3782-4f9b-b3ee-6da61012e191 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:24.994461 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:25.032385 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5317be-2513-4ae7-91ba-7b5e9fc00b4c None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:25.040075 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea1a5c-3782-4f9b-b3ee-6da61012e191 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:25.041604 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea1a5c-3782-4f9b-b3ee-6da61012e191 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:25.046853 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:25.071735 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726471b0-8474-4338-a61d-e2f9179452cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:25.072537 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726471b0-8474-4338-a61d-e2f9179452cb None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:25.072827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726471b0-8474-4338-a61d-e2f9179452cb None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:25.073103 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726471b0-8474-4338-a61d-e2f9179452cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:25.083642 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726471b0-8474-4338-a61d-e2f9179452cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:25.091652 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-726471b0-8474-4338-a61d-e2f9179452cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:03:25.091652 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:25.091652 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:25.091652 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:25.091652 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:25.091652 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:25.091652 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:25.091652 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:25.091652 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:25.091652 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:25.091652 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:25.091652 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:25.091652 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:25.091652 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:25.091652 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:25.091652 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:25.092561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:25.092561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:25.092561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:25.092561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:25.092561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:25.092561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:25.092561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:25.092561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:25.092561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:25.092561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:25.092561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:25.092561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:25.092561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:25.092561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:25.092561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:25.092561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:25.093343 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:25.093343 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:25.093343 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:25.093343 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:25.093343 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:25.093343 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:25.093343 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:25.093343 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:25.093343 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:25.093343 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:25.093343 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:03:25.093343 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:25.093343 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 222/440] 10.222.0.39 () {56 vars in 1096 bytes} [Wed May 25 15:03:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:25.094004 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726471b0-8474-4338-a61d-e2f9179452cb None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:25.145894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 219/441] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:03:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:03:25.146822 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea1a5c-3782-4f9b-b3ee-6da61012e191 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:25.198840 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726471b0-8474-4338-a61d-e2f9179452cb None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:25.203097 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:25.232258 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce82a0-e911-4688-8fd8-4ec743379a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:25.233072 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce82a0-e911-4688-8fd8-4ec743379a45 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:25.233350 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce82a0-e911-4688-8fd8-4ec743379a45 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:25.233622 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce82a0-e911-4688-8fd8-4ec743379a45 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:25.244264 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce82a0-e911-4688-8fd8-4ec743379a45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:25.247393 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea1a5c-3782-4f9b-b3ee-6da61012e191 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:25.252447 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-23ce82a0-e911-4688-8fd8-4ec743379a45 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:03:25.252447 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:25.252447 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:25.252447 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:25.252447 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:25.252447 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:25.252447 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:25.252447 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:25.252447 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:25.252447 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:25.252447 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:25.252447 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:25.252447 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:25.252447 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:25.252447 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:25.252447 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:25.253483 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:25.253483 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:25.253483 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:25.253483 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:25.253483 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:25.253483 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:25.253483 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:25.253483 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:25.253483 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:25.253483 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:25.253483 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:25.253483 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:25.253483 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:25.253483 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:25.253483 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:25.253483 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:25.254662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:25.254662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:25.254662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:25.254662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:25.254662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:25.254662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:25.254662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:25.254662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:25.254662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:25.254662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:25.254662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:03:25.254662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:25.254662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 223/442] 10.222.0.39 () {56 vars in 1114 bytes} [Wed May 25 15:03:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:25.254662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce82a0-e911-4688-8fd8-4ec743379a45 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:25.286311 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c41d4-017b-4c75-b97b-5e2d8bf93e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:25.287016 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c41d4-017b-4c75-b97b-5e2d8bf93e3c None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:25.287293 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:25.287383 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c41d4-017b-4c75-b97b-5e2d8bf93e3c None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:25.287573 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c41d4-017b-4c75-b97b-5e2d8bf93e3c None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:25.288319 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c41d4-017b-4c75-b97b-5e2d8bf93e3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:25.288671 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c41d4-017b-4c75-b97b-5e2d8bf93e3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:25.290394 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c41d4-017b-4c75-b97b-5e2d8bf93e3c None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:25.298725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 220/443] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:25.299523 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c41d4-017b-4c75-b97b-5e2d8bf93e3c None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:25.357870 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce82a0-e911-4688-8fd8-4ec743379a45 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:25.393581 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51408ce0-59fe-45c3-9ae4-6b2aaf7d7fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:25.394466 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51408ce0-59fe-45c3-9ae4-6b2aaf7d7fb7 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:25.394747 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51408ce0-59fe-45c3-9ae4-6b2aaf7d7fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:25.395030 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51408ce0-59fe-45c3-9ae4-6b2aaf7d7fb7 None admin] PATH_INFO: `/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:25.396256 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51408ce0-59fe-45c3-9ae4-6b2aaf7d7fb7 None admin] RBAC: Authorizing `identity:get_project(project_id=5ffc3171df904ff0a47f7fb65d9090cb)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:25.397684 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51408ce0-59fe-45c3-9ae4-6b2aaf7d7fb7 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:25.399420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 224/444] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:03:25 2022] GET /identity/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:25.400182 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51408ce0-59fe-45c3-9ae4-6b2aaf7d7fb7 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:25.400791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c41d4-017b-4c75-b97b-5e2d8bf93e3c None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:25.419437 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:25.438669 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225da21-8ab2-4a14-bb83-e7d00d81a89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:25.439355 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225da21-8ab2-4a14-bb83-e7d00d81a89d None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:25.439643 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225da21-8ab2-4a14-bb83-e7d00d81a89d None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:25.439924 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225da21-8ab2-4a14-bb83-e7d00d81a89d None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:25.440672 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225da21-8ab2-4a14-bb83-e7d00d81a89d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:25.441090 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225da21-8ab2-4a14-bb83-e7d00d81a89d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:25.442501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225da21-8ab2-4a14-bb83-e7d00d81a89d None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:25.451289 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 221/445] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:03:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:25.452046 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225da21-8ab2-4a14-bb83-e7d00d81a89d None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:25.500065 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:25.504069 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51408ce0-59fe-45c3-9ae4-6b2aaf7d7fb7 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:25.538637 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ace2e1-ac2f-4874-a8aa-ccae02cafe6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:25.539292 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ace2e1-ac2f-4874-a8aa-ccae02cafe6c None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:25.539571 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ace2e1-ac2f-4874-a8aa-ccae02cafe6c None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:25.539842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ace2e1-ac2f-4874-a8aa-ccae02cafe6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:25.557500 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225da21-8ab2-4a14-bb83-e7d00d81a89d None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:25.594480 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b90549-e714-4435-9ce3-6845409f9868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:25.595453 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b90549-e714-4435-9ce3-6845409f9868 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:25.595759 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b90549-e714-4435-9ce3-6845409f9868 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:25.596021 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b90549-e714-4435-9ce3-6845409f9868 None admin] PATH_INFO: `/v3/groups/726c639c29bc4a158e57e8f7d607d233` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:25.597246 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b90549-e714-4435-9ce3-6845409f9868 None admin] RBAC: Authorizing `identity:get_group(group_id=726c639c29bc4a158e57e8f7d607d233)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:25.598783 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b90549-e714-4435-9ce3-6845409f9868 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:25.600707 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 222/446] 10.222.0.39 () {56 vars in 1180 bytes} [Wed May 25 15:03:25 2022] GET /identity/v3/groups/726c639c29bc4a158e57e8f7d607d233 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:25.601481 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b90549-e714-4435-9ce3-6845409f9868 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:25.610353 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ace2e1-ac2f-4874-a8aa-ccae02cafe6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:25.611789 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ace2e1-ac2f-4874-a8aa-ccae02cafe6c None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:25.647574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:25.700793 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b90549-e714-4435-9ce3-6845409f9868 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:25.707091 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:25.711833 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 225/447] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:03:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:03:25.712723 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ace2e1-ac2f-4874-a8aa-ccae02cafe6c None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:25.740440 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63111fb9-0ed3-4d5b-85de-d971ad3fbce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:25.741103 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63111fb9-0ed3-4d5b-85de-d971ad3fbce4 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:25.741393 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63111fb9-0ed3-4d5b-85de-d971ad3fbce4 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:25.741672 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63111fb9-0ed3-4d5b-85de-d971ad3fbce4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:25.809389 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63111fb9-0ed3-4d5b-85de-d971ad3fbce4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:25.810911 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63111fb9-0ed3-4d5b-85de-d971ad3fbce4 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:25.812719 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ace2e1-ac2f-4874-a8aa-ccae02cafe6c None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:25.847343 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d734975-d880-4382-a312-2e5b0c0ac865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:25.847995 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d734975-d880-4382-a312-2e5b0c0ac865 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:25.848274 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d734975-d880-4382-a312-2e5b0c0ac865 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:25.848545 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d734975-d880-4382-a312-2e5b0c0ac865 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:25.849368 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d734975-d880-4382-a312-2e5b0c0ac865 None admin] RBAC: Adding query filter params (group.id=726c639c29bc4a158e57e8f7d607d233, role.id=3ddf578e07094ecd820c44387851dbb8, scope.project.id=5ffc3171df904ff0a47f7fb65d9090cb) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:25.849674 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d734975-d880-4382-a312-2e5b0c0ac865 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:25.851128 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d734975-d880-4382-a312-2e5b0c0ac865 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:25.856514 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:25.856953 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 226/448] 10.222.0.39 () {56 vars in 1376 bytes} [Wed May 25 15:03:25 2022] GET /identity/v3/role_assignments?group.id=726c639c29bc4a158e57e8f7d607d233&scope.project.id=5ffc3171df904ff0a47f7fb65d9090cb&role.id=3ddf578e07094ecd820c44387851dbb8 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:25.857891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d734975-d880-4382-a312-2e5b0c0ac865 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:25.928915 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 223/449] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:03:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:03:25.929408 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:25.934976 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63111fb9-0ed3-4d5b-85de-d971ad3fbce4 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:25.975790 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d734975-d880-4382-a312-2e5b0c0ac865 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:26.013673 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3f551-f1a1-462c-ac26-2b35d7a53e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:26.014832 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3f551-f1a1-462c-ac26-2b35d7a53e21 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:26.014832 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3f551-f1a1-462c-ac26-2b35d7a53e21 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:26.015130 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3f551-f1a1-462c-ac26-2b35d7a53e21 None admin] PATH_INFO: `/v3/projects/91ba3df395e34a04b262fcb06d12fb3a` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:26.016485 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3f551-f1a1-462c-ac26-2b35d7a53e21 None admin] RBAC: Authorizing `identity:get_project(project_id=91ba3df395e34a04b262fcb06d12fb3a)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:26.017963 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3f551-f1a1-462c-ac26-2b35d7a53e21 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:26.019949 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 227/450] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:03:25 2022] GET /identity/v3/projects/91ba3df395e34a04b262fcb06d12fb3a => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:26.025768 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3f551-f1a1-462c-ac26-2b35d7a53e21 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:26.051060 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63111fb9-0ed3-4d5b-85de-d971ad3fbce4 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:26.097127 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436875b4-7ba5-40dc-9041-363c41276505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:26.097366 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436875b4-7ba5-40dc-9041-363c41276505 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:26.097490 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436875b4-7ba5-40dc-9041-363c41276505 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:26.097769 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436875b4-7ba5-40dc-9041-363c41276505 None admin] PATH_INFO: `/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:26.099012 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436875b4-7ba5-40dc-9041-363c41276505 None admin] RBAC: Authorizing `identity:get_project(project_id=5ffc3171df904ff0a47f7fb65d9090cb)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:26.100473 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436875b4-7ba5-40dc-9041-363c41276505 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:26.102390 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 224/451] 10.222.0.39 () {56 vars in 1186 bytes} [Wed May 25 15:03:25 2022] GET /identity/v3/projects/5ffc3171df904ff0a47f7fb65d9090cb => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:26.107971 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436875b4-7ba5-40dc-9041-363c41276505 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:26.125849 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:26.144704 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3f551-f1a1-462c-ac26-2b35d7a53e21 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:26.182900 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:26.189239 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e56698-1069-4417-966b-6d58f4a58805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:26.190287 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e56698-1069-4417-966b-6d58f4a58805 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:26.190405 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e56698-1069-4417-966b-6d58f4a58805 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:26.190687 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e56698-1069-4417-966b-6d58f4a58805 None admin] PATH_INFO: `/v3/groups/ee3703df9f3d4d61951cdb21db7a9413` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:26.192263 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e56698-1069-4417-966b-6d58f4a58805 None admin] RBAC: Authorizing `identity:get_group(group_id=ee3703df9f3d4d61951cdb21db7a9413)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:26.195091 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e56698-1069-4417-966b-6d58f4a58805 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:26.195320 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 228/452] 10.222.0.39 () {56 vars in 1180 bytes} [Wed May 25 15:03:26 2022] GET /identity/v3/groups/ee3703df9f3d4d61951cdb21db7a9413 => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:26.201425 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e56698-1069-4417-966b-6d58f4a58805 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:26.235212 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436875b4-7ba5-40dc-9041-363c41276505 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:26.273168 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27abf00-c423-4e0b-9216-62ed64f47e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:26.274048 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27abf00-c423-4e0b-9216-62ed64f47e46 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:26.274355 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27abf00-c423-4e0b-9216-62ed64f47e46 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:26.274634 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27abf00-c423-4e0b-9216-62ed64f47e46 None admin] PATH_INFO: `/v3/groups/726c639c29bc4a158e57e8f7d607d233` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:26.275816 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27abf00-c423-4e0b-9216-62ed64f47e46 None admin] RBAC: Authorizing `identity:get_group(group_id=726c639c29bc4a158e57e8f7d607d233)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:26.277264 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27abf00-c423-4e0b-9216-62ed64f47e46 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:26.278973 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 225/453] 10.222.0.39 () {56 vars in 1180 bytes} [Wed May 25 15:03:26 2022] GET /identity/v3/groups/726c639c29bc4a158e57e8f7d607d233 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:26.284859 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27abf00-c423-4e0b-9216-62ed64f47e46 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:26.308097 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e56698-1069-4417-966b-6d58f4a58805 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:26.342665 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd544c-b638-401e-9364-f2214676c3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:26.343326 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd544c-b638-401e-9364-f2214676c3bf None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:26.343609 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd544c-b638-401e-9364-f2214676c3bf None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:26.343887 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd544c-b638-401e-9364-f2214676c3bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:26.345083 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd544c-b638-401e-9364-f2214676c3bf None admin] RBAC: Adding query filter params (group.id=ee3703df9f3d4d61951cdb21db7a9413, role.id=ff521c95c8aa454ea3daa6bc36d055b1, scope.project.id=91ba3df395e34a04b262fcb06d12fb3a) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:26.345403 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd544c-b638-401e-9364-f2214676c3bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:26.346871 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd544c-b638-401e-9364-f2214676c3bf None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:26.352941 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 229/454] 10.222.0.39 () {56 vars in 1376 bytes} [Wed May 25 15:03:26 2022] GET /identity/v3/role_assignments?group.id=ee3703df9f3d4d61951cdb21db7a9413&scope.project.id=91ba3df395e34a04b262fcb06d12fb3a&role.id=ff521c95c8aa454ea3daa6bc36d055b1 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:26.371646 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:26.392450 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27abf00-c423-4e0b-9216-62ed64f47e46 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:26.430039 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240a1e1-4b7d-4321-a013-6b032a4855f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:26.430748 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240a1e1-4b7d-4321-a013-6b032a4855f8 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:26.431012 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240a1e1-4b7d-4321-a013-6b032a4855f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:26.431602 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240a1e1-4b7d-4321-a013-6b032a4855f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:26.432450 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240a1e1-4b7d-4321-a013-6b032a4855f8 None admin] RBAC: Adding query filter params (group.id=726c639c29bc4a158e57e8f7d607d233, role.id=44e6a84e85f84d5ba38f6ee215622918, scope.project.id=5ffc3171df904ff0a47f7fb65d9090cb) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:26.432759 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240a1e1-4b7d-4321-a013-6b032a4855f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:26.434303 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240a1e1-4b7d-4321-a013-6b032a4855f8 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:26.441156 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 226/455] 10.222.0.39 () {56 vars in 1376 bytes} [Wed May 25 15:03:26 2022] GET /identity/v3/role_assignments?group.id=726c639c29bc4a158e57e8f7d607d233&scope.project.id=5ffc3171df904ff0a47f7fb65d9090cb&role.id=44e6a84e85f84d5ba38f6ee215622918 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:29.225536 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f666fb-02b1-46f0-b359-801dbd7d21b3 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:29.226631 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f666fb-02b1-46f0-b359-801dbd7d21b3 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:29.227148 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f666fb-02b1-46f0-b359-801dbd7d21b3 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:29.229131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 230/456] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:29.236007 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d8ae0-f2f5-40dc-84fd-b64fd6727d11 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:29.236915 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d8ae0-f2f5-40dc-84fd-b64fd6727d11 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:29.237394 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d8ae0-f2f5-40dc-84fd-b64fd6727d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:29.255256 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-694d8ae0-f2f5-40dc-84fd-b64fd6727d11 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:29.256791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-694d8ae0-f2f5-40dc-84fd-b64fd6727d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:29.300592 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294eef0a-f558-4a64-992d-f18afe5ab097 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:29.301220 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294eef0a-f558-4a64-992d-f18afe5ab097 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:29.301719 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294eef0a-f558-4a64-992d-f18afe5ab097 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:29.303875 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 231/457] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:29.310149 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe0347-29ec-4670-95ef-fc50fa406ad9 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:29.311013 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe0347-29ec-4670-95ef-fc50fa406ad9 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:29.311362 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe0347-29ec-4670-95ef-fc50fa406ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:29.332997 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-fcbe0347-29ec-4670-95ef-fc50fa406ad9 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:29.334280 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-fcbe0347-29ec-4670-95ef-fc50fa406ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:29.338155 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 227/458] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:29.364461 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d8ae0-f2f5-40dc-84fd-b64fd6727d11 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:29.403860 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:29.414919 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 232/459] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:29.443295 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe0347-29ec-4670-95ef-fc50fa406ad9 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:29.444627 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:29.471862 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d8ae0-f2f5-40dc-84fd-b64fd6727d11 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:29.515558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b182a-4c89-4ba3-bc95-e88bb2b0366d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:29.516336 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b182a-4c89-4ba3-bc95-e88bb2b0366d None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:29.516676 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b182a-4c89-4ba3-bc95-e88bb2b0366d None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:29.516961 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b182a-4c89-4ba3-bc95-e88bb2b0366d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:29.532429 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b182a-4c89-4ba3-bc95-e88bb2b0366d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:29.533901 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b182a-4c89-4ba3-bc95-e88bb2b0366d None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:29.553582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-889b182a-4c89-4ba3-bc95-e88bb2b0366d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:29.553582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:29.553582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:29.553582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:29.553582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:29.553582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:29.553582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:29.553582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:29.553582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:29.553582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:29.553582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:29.553582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:29.553582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:29.553582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:29.553582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:29.554555 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:29.554555 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:29.554555 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:29.554555 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:29.554555 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:29.554555 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:29.554555 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:29.554555 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:29.554555 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:29.554555 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:29.554555 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:29.554555 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:29.554555 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:29.554555 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:29.554555 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:29.554555 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:29.554555 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:29.557297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:29.557297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:29.557297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:29.557297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:29.557297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 228/460] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:03:29.557297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b46c6-ea6b-4573-b03f-58ddd19caf29 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:29.557297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b46c6-ea6b-4573-b03f-58ddd19caf29 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:29.557297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b46c6-ea6b-4573-b03f-58ddd19caf29 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:29.558711 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 229/461] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:29.561425 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b46c6-ea6b-4573-b03f-58ddd19caf29 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:29.588527 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe0347-29ec-4670-95ef-fc50fa406ad9 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:29.623430 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d991f-d9cf-4ee5-b4b3-2d2f25a38f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:29.624218 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d991f-d9cf-4ee5-b4b3-2d2f25a38f97 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:29.624499 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d991f-d9cf-4ee5-b4b3-2d2f25a38f97 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:29.624770 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d991f-d9cf-4ee5-b4b3-2d2f25a38f97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:29.635134 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d991f-d9cf-4ee5-b4b3-2d2f25a38f97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:29.636586 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950d991f-d9cf-4ee5-b4b3-2d2f25a38f97 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:29.654827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-950d991f-d9cf-4ee5-b4b3-2d2f25a38f97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:29.654827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:29.654827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:29.654827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:29.654827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:29.654827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:29.654827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:29.654827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:29.654827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:29.654827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:29.654827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:29.654827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:29.654827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:29.654827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:29.654827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:29.655745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:29.655745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:29.655745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:29.655745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:29.655745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:29.655745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:29.655745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:29.655745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:29.655745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:29.655745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:29.655745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:29.655745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:29.655745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:29.655745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:29.655745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:29.655745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:29.655745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:29.656585 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:29.656585 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:29.656585 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:29.656585 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:29.656585 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 233/462] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:29.657674 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee201b-2705-40a7-ba22-e6d9a8f81717 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:29.657674 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee201b-2705-40a7-ba22-e6d9a8f81717 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:29.657912 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee201b-2705-40a7-ba22-e6d9a8f81717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:29.675178 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-c3ee201b-2705-40a7-ba22-e6d9a8f81717 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:29.675638 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b46c6-ea6b-4573-b03f-58ddd19caf29 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:29.676356 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-c3ee201b-2705-40a7-ba22-e6d9a8f81717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:29.707251 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:29.716491 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ffdbc-a3e0-410e-8417-83ebf3e41fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:29.717157 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ffdbc-a3e0-410e-8417-83ebf3e41fec None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:29.717437 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ffdbc-a3e0-410e-8417-83ebf3e41fec None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:29.717708 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ffdbc-a3e0-410e-8417-83ebf3e41fec None admin] PATH_INFO: `/v3/domains` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:29.718461 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ffdbc-a3e0-410e-8417-83ebf3e41fec None admin] RBAC: Adding query filter params (name=Default) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:29.718766 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ffdbc-a3e0-410e-8417-83ebf3e41fec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:29.720629 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ffdbc-a3e0-410e-8417-83ebf3e41fec None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:29.723267 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:29.731945 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 230/463] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:29.736796 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ffdbc-a3e0-410e-8417-83ebf3e41fec None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:29.748025 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 234/464] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:29.749359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f79157-0187-456f-bf7f-f7201fcf1bea None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:29.749629 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f79157-0187-456f-bf7f-f7201fcf1bea None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:29.749895 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f79157-0187-456f-bf7f-f7201fcf1bea None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:29.751520 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 235/465] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:29.752185 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f79157-0187-456f-bf7f-f7201fcf1bea None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:29.841837 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ffdbc-a3e0-410e-8417-83ebf3e41fec None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:29.856228 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f79157-0187-456f-bf7f-f7201fcf1bea None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:29.875983 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c192a-92db-4caf-8ece-56613e0f0ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:29.876646 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c192a-92db-4caf-8ece-56613e0f0ebc None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:29.876927 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c192a-92db-4caf-8ece-56613e0f0ebc None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:29.877199 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c192a-92db-4caf-8ece-56613e0f0ebc None admin] PATH_INFO: `/v3/domains` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:29.877936 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c192a-92db-4caf-8ece-56613e0f0ebc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:29.878219 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c192a-92db-4caf-8ece-56613e0f0ebc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:29.879614 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c192a-92db-4caf-8ece-56613e0f0ebc None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:29.891863 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 231/466] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:29.893079 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007a81b-4644-4b76-b25d-f7e0e37036ac None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:29.893365 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007a81b-4644-4b76-b25d-f7e0e37036ac None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:29.893636 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007a81b-4644-4b76-b25d-f7e0e37036ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:29.897778 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394694a-19d2-4ab7-b047-be9b48831621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:29.898503 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394694a-19d2-4ab7-b047-be9b48831621 None admin] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:29.898790 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394694a-19d2-4ab7-b047-be9b48831621 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:29.899075 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394694a-19d2-4ab7-b047-be9b48831621 None admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:29.899802 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394694a-19d2-4ab7-b047-be9b48831621 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:29.901255 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394694a-19d2-4ab7-b047-be9b48831621 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:29.909378 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-5007a81b-4644-4b76-b25d-f7e0e37036ac None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:29.910596 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-5007a81b-4644-4b76-b25d-f7e0e37036ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:29.922602 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 236/467] 10.222.0.39 () {60 vars in 1132 bytes} [Wed May 25 15:03:29 2022] POST /identity/v3/users => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:29.923579 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394694a-19d2-4ab7-b047-be9b48831621 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:29.961574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:29.977915 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:29.990335 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 232/468] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:29.991061 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007a81b-4644-4b76-b25d-f7e0e37036ac None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:30.078105 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394694a-19d2-4ab7-b047-be9b48831621 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:30.116698 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007a81b-4644-4b76-b25d-f7e0e37036ac None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:30.118164 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8befb1-d2ab-4193-89ca-653d4968ead9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:30.119849 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8befb1-d2ab-4193-89ca-653d4968ead9 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:30.120133 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8befb1-d2ab-4193-89ca-653d4968ead9 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:30.120402 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8befb1-d2ab-4193-89ca-653d4968ead9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:30.132486 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8befb1-d2ab-4193-89ca-653d4968ead9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:30.133957 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8befb1-d2ab-4193-89ca-653d4968ead9 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:30.152879 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-aa8befb1-d2ab-4193-89ca-653d4968ead9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:30.152879 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:30.152879 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:30.152879 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:30.152879 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:30.152879 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:30.152879 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:30.152879 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:30.152879 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:30.152879 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:30.152879 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:30.152879 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:30.152879 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:30.152879 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:30.152879 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:30.153944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:30.153944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:30.153944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:30.153944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:30.153944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:30.153944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:30.153944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:30.153944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:30.153944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:30.153944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:30.153944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:30.153944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:30.153944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:30.153944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:30.153944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:30.153944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:30.153944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:30.154868 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:30.154868 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:30.154868 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:30.154868 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:30.154868 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 237/469] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:30.155943 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8befb1-d2ab-4193-89ca-653d4968ead9 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:30.163213 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec0163-fd18-4570-b6eb-d070b0601f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:30.163909 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec0163-fd18-4570-b6eb-d070b0601f5d None admin] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:30.164195 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec0163-fd18-4570-b6eb-d070b0601f5d None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:30.164482 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec0163-fd18-4570-b6eb-d070b0601f5d None admin] PATH_INFO: `/v3/users` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:30.165198 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec0163-fd18-4570-b6eb-d070b0601f5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:30.166715 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec0163-fd18-4570-b6eb-d070b0601f5d None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:30.195727 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 233/470] 10.222.0.39 () {60 vars in 1132 bytes} [Wed May 25 15:03:29 2022] POST /identity/v3/users => generated 248 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:30.196413 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec0163-fd18-4570-b6eb-d070b0601f5d None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:30.242706 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:30.276070 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:30.306252 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8befb1-d2ab-4193-89ca-653d4968ead9 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:30.313496 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec0163-fd18-4570-b6eb-d070b0601f5d None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:30.354046 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11a43e-ea7b-4357-8950-7c4396035495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:30.354797 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11a43e-ea7b-4357-8950-7c4396035495 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:30.355100 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11a43e-ea7b-4357-8950-7c4396035495 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:30.355354 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11a43e-ea7b-4357-8950-7c4396035495 None admin] PATH_INFO: `/v3/domains` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:30.356091 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11a43e-ea7b-4357-8950-7c4396035495 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:30.356352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b18740-396b-472f-b7ba-e2119972558d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:30.356482 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11a43e-ea7b-4357-8950-7c4396035495 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:30.357518 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b18740-396b-472f-b7ba-e2119972558d None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:30.357820 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11a43e-ea7b-4357-8950-7c4396035495 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:30.358212 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b18740-396b-472f-b7ba-e2119972558d None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:30.358717 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b18740-396b-472f-b7ba-e2119972558d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:30.371500 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 234/471] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:30.380438 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b18740-396b-472f-b7ba-e2119972558d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:30.380438 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b18740-396b-472f-b7ba-e2119972558d None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:30.380722 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11a43e-ea7b-4357-8950-7c4396035495 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:30.401659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-c2b18740-396b-472f-b7ba-e2119972558d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:30.401659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:30.401659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:30.401659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:30.401659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:30.401659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:30.401659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:30.401659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:30.401659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:30.401659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:30.401659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:30.401659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:30.401659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:30.401659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:30.401659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:30.402610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:30.402610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:30.402610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:30.402610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:30.402610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:30.402610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:30.402610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:30.402610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:30.402610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:30.402610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:30.402610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:30.402610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:30.402610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:30.402610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:30.402610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:30.402610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:30.402610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:30.403449 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:30.403449 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:30.403449 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:30.403449 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:30.403653 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 238/472] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:30.413877 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b18740-396b-472f-b7ba-e2119972558d None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:30.512904 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:30.519316 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11a43e-ea7b-4357-8950-7c4396035495 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:30.559750 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b18740-396b-472f-b7ba-e2119972558d None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:30.582163 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a37ae-35c2-48d2-9f76-5e8d9079c3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:30.583044 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a37ae-35c2-48d2-9f76-5e8d9079c3d6 None admin] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:30.583338 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a37ae-35c2-48d2-9f76-5e8d9079c3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:30.583617 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a37ae-35c2-48d2-9f76-5e8d9079c3d6 None admin] PATH_INFO: `/v3/users` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:30.584341 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a37ae-35c2-48d2-9f76-5e8d9079c3d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:30.586023 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a37ae-35c2-48d2-9f76-5e8d9079c3d6 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:30.598381 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaaafca-37f5-4159-b473-319027375bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:30.599162 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaafca-37f5-4159-b473-319027375bab None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:30.599507 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaafca-37f5-4159-b473-319027375bab None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:30.599866 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaafca-37f5-4159-b473-319027375bab None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:30.600687 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaaafca-37f5-4159-b473-319027375bab None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:30.600996 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaaafca-37f5-4159-b473-319027375bab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:30.602611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaaafca-37f5-4159-b473-319027375bab None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:30.605684 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:30.618629 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 239/474] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:30.618903 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 235/474] 10.222.0.39 () {60 vars in 1132 bytes} [Wed May 25 15:03:30 2022] POST /identity/v3/users => generated 248 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:30.623445 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaaafca-37f5-4159-b473-319027375bab None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:30.745658 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaaafca-37f5-4159-b473-319027375bab None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:30.786940 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03627f-9aff-47cb-8834-29ac83b824f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:30.787638 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03627f-9aff-47cb-8834-29ac83b824f6 None admin] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:30.787922 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03627f-9aff-47cb-8834-29ac83b824f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:30.788199 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03627f-9aff-47cb-8834-29ac83b824f6 None admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:30.788935 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03627f-9aff-47cb-8834-29ac83b824f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:30.790524 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03627f-9aff-47cb-8834-29ac83b824f6 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:30.815224 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 240/475] 10.222.0.39 () {60 vars in 1132 bytes} [Wed May 25 15:03:30 2022] POST /identity/v3/users => generated 249 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:03:32.275581 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37605fba-114b-4aa8-97ff-be800a25a5bc None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:32.276143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37605fba-114b-4aa8-97ff-be800a25a5bc None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:32.276143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37605fba-114b-4aa8-97ff-be800a25a5bc None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:32.277652 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 236/476] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:32.283266 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fdc87-f46b-4080-b736-3c4a5ff41153 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:32.284104 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fdc87-f46b-4080-b736-3c4a5ff41153 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:32.284577 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fdc87-f46b-4080-b736-3c4a5ff41153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:32.301992 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-150fdc87-f46b-4080-b736-3c4a5ff41153 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:32.303529 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-150fdc87-f46b-4080-b736-3c4a5ff41153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:32.351265 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:32.377234 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 241/477] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:03:32.402228 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37605fba-114b-4aa8-97ff-be800a25a5bc None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:32.517590 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37605fba-114b-4aa8-97ff-be800a25a5bc None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:32.554785 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787af63-aecf-4d32-946d-31f49f59c7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:32.555543 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787af63-aecf-4d32-946d-31f49f59c7e2 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:32.555831 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787af63-aecf-4d32-946d-31f49f59c7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:32.556109 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787af63-aecf-4d32-946d-31f49f59c7e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:32.568434 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787af63-aecf-4d32-946d-31f49f59c7e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:32.576704 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-4787af63-aecf-4d32-946d-31f49f59c7e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:32.576704 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:32.576704 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:32.576704 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:32.576704 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:32.576704 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:32.576704 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:32.576704 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:32.576704 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:32.576704 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:32.576704 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:32.576704 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:32.576704 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:32.576704 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:32.576704 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:32.576704 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:32.577790 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:32.577790 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:32.577790 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:32.577790 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:32.577790 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:32.577790 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:32.577790 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:32.577790 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:32.577790 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:32.577790 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:32.577790 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:32.577790 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:32.577790 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:32.577790 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:32.577790 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:32.577790 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:32.578802 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:32.578802 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:32.578802 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:32.578802 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:32.578802 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:32.578802 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:32.578802 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:32.578802 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:32.578802 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:32.578802 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:32.578802 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:32.578802 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:32.578802 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 237/478] 10.222.0.39 () {56 vars in 1102 bytes} [Wed May 25 15:03:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:32.583903 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fdc87-f46b-4080-b736-3c4a5ff41153 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:32.589098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907790e-8b41-4695-b581-e63ba596043f None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:32.589393 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907790e-8b41-4695-b581-e63ba596043f None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:32.589679 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907790e-8b41-4695-b581-e63ba596043f None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:32.591461 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 238/479] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:03:32.596378 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf7323-a60c-43ad-b51a-64db256ba221 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:32.596673 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf7323-a60c-43ad-b51a-64db256ba221 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:32.596957 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf7323-a60c-43ad-b51a-64db256ba221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:32.614474 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-5edf7323-a60c-43ad-b51a-64db256ba221 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:32.615815 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-5edf7323-a60c-43ad-b51a-64db256ba221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:32.619958 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:32.698527 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 239/480] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:03:32.706976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fdc87-f46b-4080-b736-3c4a5ff41153 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:32.718748 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf7323-a60c-43ad-b51a-64db256ba221 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:32.754565 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404353a6-0a3e-403d-8e56-8694f5c4458e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:32.756242 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404353a6-0a3e-403d-8e56-8694f5c4458e None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:32.756830 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404353a6-0a3e-403d-8e56-8694f5c4458e None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:32.757321 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404353a6-0a3e-403d-8e56-8694f5c4458e None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:32.758995 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404353a6-0a3e-403d-8e56-8694f5c4458e None admin] RBAC: Adding query filter params (name=service) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:32.759788 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404353a6-0a3e-403d-8e56-8694f5c4458e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:32.762026 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404353a6-0a3e-403d-8e56-8694f5c4458e None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:32.773787 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 242/481] 10.222.0.39 () {56 vars in 1103 bytes} [Wed May 25 15:03:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:32.782271 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404353a6-0a3e-403d-8e56-8694f5c4458e None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:32.827496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:32.862291 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf7323-a60c-43ad-b51a-64db256ba221 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:32.889997 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404353a6-0a3e-403d-8e56-8694f5c4458e None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:32.904034 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f21a7e-c6d2-4262-8c65-d3ff592a8d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:32.904860 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f21a7e-c6d2-4262-8c65-d3ff592a8d50 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:32.905143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f21a7e-c6d2-4262-8c65-d3ff592a8d50 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:32.905419 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f21a7e-c6d2-4262-8c65-d3ff592a8d50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:32.914612 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:32.918943 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f21a7e-c6d2-4262-8c65-d3ff592a8d50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:32.927761 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-a8f21a7e-c6d2-4262-8c65-d3ff592a8d50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:32.927761 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:32.927761 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:32.927761 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:32.927761 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:32.927761 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:32.927761 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:32.927761 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:32.927761 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:32.927761 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:32.927761 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:32.927761 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:32.927761 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:32.927761 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:32.927761 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:32.927761 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:32.928651 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:32.928651 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:32.928651 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:32.928651 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:32.928651 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:32.928651 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:32.928651 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:32.928651 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:32.928651 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:32.928651 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:32.928651 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:32.928651 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:32.928651 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:32.928651 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:32.928651 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:32.928651 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:32.929455 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:32.929455 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:32.929455 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:32.929455 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:32.929455 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:32.929455 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:32.929455 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:32.929455 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:32.929455 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:32.929455 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:32.929455 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:32.929455 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:32.930056 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d66635-1f76-433a-88c5-8c18bdb8429f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:32.930056 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d66635-1f76-433a-88c5-8c18bdb8429f None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:32.930056 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d66635-1f76-433a-88c5-8c18bdb8429f None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:32.930056 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d66635-1f76-433a-88c5-8c18bdb8429f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:32.934264 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 240/482] 10.222.0.39 () {56 vars in 1102 bytes} [Wed May 25 15:03:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:03:32.935162 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f21a7e-c6d2-4262-8c65-d3ff592a8d50 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:32.942744 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d66635-1f76-433a-88c5-8c18bdb8429f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:32.944269 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d66635-1f76-433a-88c5-8c18bdb8429f None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:32.963519 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-f9d66635-1f76-433a-88c5-8c18bdb8429f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:32.963519 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:32.963519 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:32.963519 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:32.963519 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:32.963519 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:32.963519 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:32.963519 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:32.963519 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:32.963519 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:32.963519 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:32.963519 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:32.963519 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:32.963519 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:32.963519 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:32.965560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:32.965560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:32.965560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:32.965560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:32.965560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:32.965560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:32.965560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:32.965560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:32.965560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:32.965560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:32.965560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:32.965560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:32.965560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:32.965560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:32.965560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:32.965560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:32.965560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:32.967629 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:32.967629 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:32.967629 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:32.967629 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:32.974263 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 243/483] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:03:32.974263 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d66635-1f76-433a-88c5-8c18bdb8429f None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:33.049602 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f21a7e-c6d2-4262-8c65-d3ff592a8d50 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:33.082517 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:33.091144 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d66635-1f76-433a-88c5-8c18bdb8429f None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:33.095152 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd60d4-11c4-402d-ae5d-e3235c4638f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:33.095973 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd60d4-11c4-402d-ae5d-e3235c4638f6 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:33.096254 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd60d4-11c4-402d-ae5d-e3235c4638f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:33.096569 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd60d4-11c4-402d-ae5d-e3235c4638f6 None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:33.097329 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd60d4-11c4-402d-ae5d-e3235c4638f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:33.097676 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd60d4-11c4-402d-ae5d-e3235c4638f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:33.099573 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd60d4-11c4-402d-ae5d-e3235c4638f6 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:33.112857 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 241/484] 10.222.0.39 () {56 vars in 1103 bytes} [Wed May 25 15:03:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:33.112857 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8ed8e-c5c9-40ca-baf7-d5476d2c3ffd None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:33.112857 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8ed8e-c5c9-40ca-baf7-d5476d2c3ffd None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:33.112857 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8ed8e-c5c9-40ca-baf7-d5476d2c3ffd None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:33.113181 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 242/485] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:33.114397 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8ed8e-c5c9-40ca-baf7-d5476d2c3ffd None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:33.133007 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d89ce-9727-464c-b30e-cee81d6e4c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:33.133715 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d89ce-9727-464c-b30e-cee81d6e4c8f None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:33.133983 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d89ce-9727-464c-b30e-cee81d6e4c8f None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:33.134226 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d89ce-9727-464c-b30e-cee81d6e4c8f None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:33.134975 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d89ce-9727-464c-b30e-cee81d6e4c8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:33.135285 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d89ce-9727-464c-b30e-cee81d6e4c8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:33.136656 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d89ce-9727-464c-b30e-cee81d6e4c8f None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:33.149265 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 244/486] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:33.150367 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147752d-78c7-4721-accd-796583abe244 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:33.150654 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147752d-78c7-4721-accd-796583abe244 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:33.150929 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147752d-78c7-4721-accd-796583abe244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:33.167847 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-2147752d-78c7-4721-accd-796583abe244 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:33.168986 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-2147752d-78c7-4721-accd-796583abe244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:33.187077 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:33.230504 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8ed8e-c5c9-40ca-baf7-d5476d2c3ffd None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:33.257490 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 245/487] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:33.257490 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147752d-78c7-4721-accd-796583abe244 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:33.269836 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00b7db-048e-4cb8-a778-40b265af6db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:33.270744 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00b7db-048e-4cb8-a778-40b265af6db1 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:33.271037 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00b7db-048e-4cb8-a778-40b265af6db1 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:33.271309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00b7db-048e-4cb8-a778-40b265af6db1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:33.283239 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00b7db-048e-4cb8-a778-40b265af6db1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:33.284746 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00b7db-048e-4cb8-a778-40b265af6db1 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:33.303048 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-1c00b7db-048e-4cb8-a778-40b265af6db1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:33.303048 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:33.303048 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:33.303048 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:33.303048 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:33.303048 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:33.303048 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:33.303048 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:33.303048 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:33.303048 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:33.303048 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:33.303048 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:33.303048 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:33.303048 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:33.303048 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:33.304023 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:33.304023 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:33.304023 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:33.304023 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:33.304023 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:33.304023 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:33.304023 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:33.304023 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:33.304023 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:33.304023 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:33.304023 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:33.304023 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:33.304023 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:33.304023 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:33.304023 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:33.304023 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:33.304023 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:33.304880 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:33.304880 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:33.304880 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:33.304880 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:33.304880 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 243/488] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:33.305638 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2de93f-91bd-498b-a8e6-3db1360e3c3b None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:33.305933 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2de93f-91bd-498b-a8e6-3db1360e3c3b None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:33.306214 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2de93f-91bd-498b-a8e6-3db1360e3c3b None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:33.308072 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 244/489] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:33.308694 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2de93f-91bd-498b-a8e6-3db1360e3c3b None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:33.355392 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:33.370923 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147752d-78c7-4721-accd-796583abe244 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:33.405109 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71dd242-5a35-41c1-9ed3-04b2520ef8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:33.405910 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71dd242-5a35-41c1-9ed3-04b2520ef8d9 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:33.406192 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71dd242-5a35-41c1-9ed3-04b2520ef8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:33.406501 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71dd242-5a35-41c1-9ed3-04b2520ef8d9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:33.413682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2de93f-91bd-498b-a8e6-3db1360e3c3b None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:33.414002 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71dd242-5a35-41c1-9ed3-04b2520ef8d9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:33.415492 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71dd242-5a35-41c1-9ed3-04b2520ef8d9 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:33.428597 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:33.431390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-b71dd242-5a35-41c1-9ed3-04b2520ef8d9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 15:03:33.431390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:33.431390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:33.431390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:33.431390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:33.431390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:33.431390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:33.431390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:33.431390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:33.431390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:33.431390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:33.431390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:33.431390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:03:33.431390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:03:33.431390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:03:33.431390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:03:33.432607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:33.432607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:33.432607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:03:33.432607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:33.432607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:03:33.432607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:33.432607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:33.432607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:33.432607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:33.432607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:33.432607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:33.432607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:33.432607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:33.432607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:33.432607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:33.432607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:33.432607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:33.432607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:33.438620 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:33.438620 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:33.438620 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:03:33.438620 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:03:33.438620 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:03:33.438620 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:03:33.438620 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:03:33.438620 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:03:33.438620 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 15:03:33.438620 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:33.438620 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 246/490] 10.222.0.39 () {56 vars in 1093 bytes} [Wed May 25 15:03:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:33.438620 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71dd242-5a35-41c1-9ed3-04b2520ef8d9 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:33.452941 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f14410-50bc-40c7-a10f-f6b64480a647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:33.453765 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f14410-50bc-40c7-a10f-f6b64480a647 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:33.454205 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f14410-50bc-40c7-a10f-f6b64480a647 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:33.454515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f14410-50bc-40c7-a10f-f6b64480a647 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:33.465823 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f14410-50bc-40c7-a10f-f6b64480a647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:33.473853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-b4f14410-50bc-40c7-a10f-f6b64480a647 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:33.473853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:33.473853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:33.473853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:33.473853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:33.473853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:33.473853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:33.473853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:33.473853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:33.473853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:33.473853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:33.473853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:33.473853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:33.473853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:33.473853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:33.473853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:33.474875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:33.474875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:33.474875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:33.474875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:33.474875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:33.474875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:33.474875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:33.474875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:33.474875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:33.474875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:33.474875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:33.474875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:33.474875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:33.474875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:33.474875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:33.474875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:33.475664 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:33.475664 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:33.475664 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:33.475664 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:33.475664 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:33.475664 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:33.475664 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:33.475664 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:33.475664 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:33.475664 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:33.475664 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:33.475664 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:33.475664 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 245/491] 10.222.0.39 () {56 vars in 1102 bytes} [Wed May 25 15:03:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:33.476303 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f245ea-162b-49fd-aa14-ec5f070434bf None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:33.476760 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f245ea-162b-49fd-aa14-ec5f070434bf None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:33.476852 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f245ea-162b-49fd-aa14-ec5f070434bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:33.494986 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-85f245ea-162b-49fd-aa14-ec5f070434bf None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:33.496338 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-85f245ea-162b-49fd-aa14-ec5f070434bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:33.542896 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71dd242-5a35-41c1-9ed3-04b2520ef8d9 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:33.570412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 246/492] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:33.570412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f245ea-162b-49fd-aa14-ec5f070434bf None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:33.585764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77060404-2a57-4e7c-8fef-85637b9ed22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:33.586467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77060404-2a57-4e7c-8fef-85637b9ed22e None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:33.586749 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77060404-2a57-4e7c-8fef-85637b9ed22e None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:33.587018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77060404-2a57-4e7c-8fef-85637b9ed22e None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:33.587738 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77060404-2a57-4e7c-8fef-85637b9ed22e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:33.588046 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77060404-2a57-4e7c-8fef-85637b9ed22e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:33.589416 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77060404-2a57-4e7c-8fef-85637b9ed22e None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:33.606228 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 247/493] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:33.606228 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77060404-2a57-4e7c-8fef-85637b9ed22e None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:33.611155 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:33.669975 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f245ea-162b-49fd-aa14-ec5f070434bf None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:33.672346 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:33.706949 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c95feb-a0e0-448a-b275-ba0886049e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:33.707298 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77060404-2a57-4e7c-8fef-85637b9ed22e None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:33.707624 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c95feb-a0e0-448a-b275-ba0886049e53 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:33.707907 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c95feb-a0e0-448a-b275-ba0886049e53 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:33.708228 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c95feb-a0e0-448a-b275-ba0886049e53 None admin] PATH_INFO: `/v3/users` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:33.709059 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c95feb-a0e0-448a-b275-ba0886049e53 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:33.709337 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c95feb-a0e0-448a-b275-ba0886049e53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:33.710857 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c95feb-a0e0-448a-b275-ba0886049e53 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:33.742335 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec52dcc-0c53-4dad-afff-979aee139dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:33.743002 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec52dcc-0c53-4dad-afff-979aee139dad None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:33.743283 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec52dcc-0c53-4dad-afff-979aee139dad None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:33.743553 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec52dcc-0c53-4dad-afff-979aee139dad None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:33.744294 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec52dcc-0c53-4dad-afff-979aee139dad None admin] RBAC: Adding query filter params (name=service) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:33.744595 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec52dcc-0c53-4dad-afff-979aee139dad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:33.745966 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec52dcc-0c53-4dad-afff-979aee139dad None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:33.747499 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 247/494] 10.222.0.39 () {56 vars in 1133 bytes} [Wed May 25 15:03:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:33.748339 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c95feb-a0e0-448a-b275-ba0886049e53 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:33.758676 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 248/495] 10.222.0.39 () {56 vars in 1103 bytes} [Wed May 25 15:03:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:33.759511 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec52dcc-0c53-4dad-afff-979aee139dad None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:33.830173 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:33.859380 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c95feb-a0e0-448a-b275-ba0886049e53 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:33.867019 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec52dcc-0c53-4dad-afff-979aee139dad None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:33.896026 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37488681-7071-4010-a51c-7546057b308e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:33.896929 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37488681-7071-4010-a51c-7546057b308e None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:33.897218 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37488681-7071-4010-a51c-7546057b308e None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:33.897500 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37488681-7071-4010-a51c-7546057b308e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:33.902339 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707f11b-9830-4a20-9af4-8b10a670d341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:33.903151 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707f11b-9830-4a20-9af4-8b10a670d341 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:33.903457 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707f11b-9830-4a20-9af4-8b10a670d341 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:33.903724 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707f11b-9830-4a20-9af4-8b10a670d341 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:33.909128 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37488681-7071-4010-a51c-7546057b308e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:33.912418 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707f11b-9830-4a20-9af4-8b10a670d341 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:33.913891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707f11b-9830-4a20-9af4-8b10a670d341 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:33.917361 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-37488681-7071-4010-a51c-7546057b308e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:33.917361 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:33.917361 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:33.917361 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:33.917361 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:33.917361 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:33.917361 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:33.917361 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:33.917361 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:33.917361 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:33.917361 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:33.917361 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:33.917361 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:33.917361 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:33.917361 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:33.917361 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:33.918324 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:33.918324 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:33.918324 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:33.918324 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:33.918324 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:33.918324 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:33.918324 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:33.918324 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:33.918324 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:33.918324 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:33.918324 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:33.918324 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:33.918324 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:33.918324 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:33.918324 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:33.918324 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:33.919096 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:33.919096 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:33.919096 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:33.919096 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:33.919096 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:33.919096 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:33.919096 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:33.919096 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:33.919096 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:33.919096 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:33.919096 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:33.919096 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:33.919096 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 248/496] 10.222.0.39 () {56 vars in 1102 bytes} [Wed May 25 15:03:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:33.919745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37488681-7071-4010-a51c-7546057b308e None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:33.929055 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-2707f11b-9830-4a20-9af4-8b10a670d341 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 15:03:33.929055 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:33.929055 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:33.929055 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:33.929055 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:33.929055 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:33.929055 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:33.929055 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:33.929055 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:33.929055 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:33.929055 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:33.929055 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:33.929055 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:03:33.929055 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:03:33.929055 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:03:33.929055 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:03:33.930023 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:33.930023 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:33.930023 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:03:33.930023 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:33.930023 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:03:33.930023 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:33.930023 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:33.930023 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:33.930023 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:33.930023 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:33.930023 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:33.930023 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:33.930023 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:33.930023 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:33.930023 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:33.930023 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:33.930023 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:33.930023 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:33.930971 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:33.930971 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:33.930971 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:03:33.930971 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:03:33.930971 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:03:33.930971 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:03:33.930971 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:03:33.930971 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:03:33.930971 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 15:03:33.930971 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:33.930971 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 249/497] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:33.932033 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707f11b-9830-4a20-9af4-8b10a670d341 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:33.952898 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:34.050827 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37488681-7071-4010-a51c-7546057b308e None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:34.074451 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707f11b-9830-4a20-9af4-8b10a670d341 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:34.098703 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba852069-9f93-483c-80f4-b7a9c02573cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:34.099631 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba852069-9f93-483c-80f4-b7a9c02573cf None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:34.099911 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba852069-9f93-483c-80f4-b7a9c02573cf None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:34.100182 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba852069-9f93-483c-80f4-b7a9c02573cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:34.105456 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:34.115882 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790e58a-6d0e-4411-baef-90acc1e6d1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:34.116728 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790e58a-6d0e-4411-baef-90acc1e6d1e4 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:34.117176 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790e58a-6d0e-4411-baef-90acc1e6d1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:34.117624 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790e58a-6d0e-4411-baef-90acc1e6d1e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:34.133141 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790e58a-6d0e-4411-baef-90acc1e6d1e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:34.134645 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790e58a-6d0e-4411-baef-90acc1e6d1e4 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:34.153806 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-8790e58a-6d0e-4411-baef-90acc1e6d1e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:34.153806 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:34.153806 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:34.153806 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:34.153806 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:34.153806 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:34.153806 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:34.153806 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:34.153806 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:34.153806 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:34.153806 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:34.153806 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:34.153806 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:34.153806 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:34.153806 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:34.155191 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:34.155191 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:34.155191 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:34.155191 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:34.155191 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:34.155191 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:34.155191 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:34.155191 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:34.155191 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:34.155191 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:34.155191 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:34.155191 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:34.155191 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:34.155191 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:34.155191 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:34.155191 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:34.155191 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:34.156015 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:34.156015 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:34.156015 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:34.156015 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:34.156015 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 250/498] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:34.156015 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790e58a-6d0e-4411-baef-90acc1e6d1e4 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:34.184700 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba852069-9f93-483c-80f4-b7a9c02573cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:34.186261 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba852069-9f93-483c-80f4-b7a9c02573cf None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:34.213935 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:34.275123 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790e58a-6d0e-4411-baef-90acc1e6d1e4 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:34.303490 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 249/499] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:03:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:03:34.304368 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba852069-9f93-483c-80f4-b7a9c02573cf None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:34.319127 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08788f12-63c3-4723-877c-c4aaaad47e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:34.320099 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08788f12-63c3-4723-877c-c4aaaad47e5d None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:34.320099 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08788f12-63c3-4723-877c-c4aaaad47e5d None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:34.320247 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08788f12-63c3-4723-877c-c4aaaad47e5d None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:34.320896 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08788f12-63c3-4723-877c-c4aaaad47e5d None admin] RBAC: Adding query filter params (name=service) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:34.321207 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08788f12-63c3-4723-877c-c4aaaad47e5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:34.322644 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08788f12-63c3-4723-877c-c4aaaad47e5d None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:34.331768 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 251/500] 10.222.0.39 () {56 vars in 1103 bytes} [Wed May 25 15:03:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:34.336831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08788f12-63c3-4723-877c-c4aaaad47e5d None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:34.385564 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:34.432785 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba852069-9f93-483c-80f4-b7a9c02573cf None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:34.450931 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08788f12-63c3-4723-877c-c4aaaad47e5d None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:34.461420 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:34.478016 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79efe9-da91-4afe-ae90-b904a7aff77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:34.478733 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79efe9-da91-4afe-ae90-b904a7aff77c None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:34.479018 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79efe9-da91-4afe-ae90-b904a7aff77c None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:34.479297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79efe9-da91-4afe-ae90-b904a7aff77c None admin] PATH_INFO: `/v3/users` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:34.480452 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79efe9-da91-4afe-ae90-b904a7aff77c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:34.480764 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79efe9-da91-4afe-ae90-b904a7aff77c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:34.482210 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79efe9-da91-4afe-ae90-b904a7aff77c None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:34.494077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfb0fb-e2a8-432b-90cd-2bf884ba1e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:34.494796 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfb0fb-e2a8-432b-90cd-2bf884ba1e3c None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:34.495092 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfb0fb-e2a8-432b-90cd-2bf884ba1e3c None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:34.495372 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfb0fb-e2a8-432b-90cd-2bf884ba1e3c None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:34.496103 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfb0fb-e2a8-432b-90cd-2bf884ba1e3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:34.496414 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfb0fb-e2a8-432b-90cd-2bf884ba1e3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:34.497804 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfb0fb-e2a8-432b-90cd-2bf884ba1e3c None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:34.501688 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 250/501] 10.222.0.39 () {56 vars in 1137 bytes} [Wed May 25 15:03:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:34.504355 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79efe9-da91-4afe-ae90-b904a7aff77c None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:34.512605 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 252/502] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:34.513482 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfb0fb-e2a8-432b-90cd-2bf884ba1e3c None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:34.621678 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfb0fb-e2a8-432b-90cd-2bf884ba1e3c None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:34.622052 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79efe9-da91-4afe-ae90-b904a7aff77c None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:34.623306 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:34.664107 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ed348-783b-42cc-ac99-907f5293d348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:34.664508 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4e52e-5fba-4323-98b5-e5672cec9301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:34.664888 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ed348-783b-42cc-ac99-907f5293d348 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:34.665170 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ed348-783b-42cc-ac99-907f5293d348 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:34.665317 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4e52e-5fba-4323-98b5-e5672cec9301 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:34.665444 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ed348-783b-42cc-ac99-907f5293d348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:34.665591 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4e52e-5fba-4323-98b5-e5672cec9301 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:34.665864 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4e52e-5fba-4323-98b5-e5672cec9301 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:34.677326 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4e52e-5fba-4323-98b5-e5672cec9301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:34.677523 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ed348-783b-42cc-ac99-907f5293d348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:34.678817 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4e52e-5fba-4323-98b5-e5672cec9301 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:34.678969 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ed348-783b-42cc-ac99-907f5293d348 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:34.698390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-873ed348-783b-42cc-ac99-907f5293d348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:34.698390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:34.698390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:34.698390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:34.698390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:34.698390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:34.698390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:34.698390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:34.698390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:34.698390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:34.698390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:34.698390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:34.698390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:34.698390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:34.698390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:34.699327 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:34.699327 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:34.699327 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:34.699327 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:34.699327 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:34.699327 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:34.699327 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:34.699327 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:34.699327 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:34.699327 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:34.699327 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:34.699327 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:34.699327 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:34.699327 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:34.699327 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:34.699327 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:34.699327 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:34.700196 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:34.700196 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:34.700196 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:34.700196 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:34.700401 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-37b4e52e-5fba-4323-98b5-e5672cec9301 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:34.700401 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:34.700401 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:34.700401 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:34.700401 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:34.700401 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:34.700401 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:34.700401 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:34.700401 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:34.700401 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:34.700401 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:34.700401 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:34.700401 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:34.700401 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:34.700401 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:34.701173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:34.701173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:34.701173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:34.701173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:34.701173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:34.701173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:34.701173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:34.701173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:34.701173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:34.701173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:34.701173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:34.701173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:34.701173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:34.701173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:34.701173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:34.701173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:34.701173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:34.702029 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:34.702029 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:34.702029 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:34.702029 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:34.702268 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 253/503] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:34.702268 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ed348-783b-42cc-ac99-907f5293d348 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:34.702389 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 251/504] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:34.703206 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4e52e-5fba-4323-98b5-e5672cec9301 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:34.745320 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:34.814346 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ed348-783b-42cc-ac99-907f5293d348 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:34.826018 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4e52e-5fba-4323-98b5-e5672cec9301 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:34.855869 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0fc0e-7ec8-47e1-a053-fd480a666b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:34.856905 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0fc0e-7ec8-47e1-a053-fd480a666b83 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:34.857364 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0fc0e-7ec8-47e1-a053-fd480a666b83 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:34.857819 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0fc0e-7ec8-47e1-a053-fd480a666b83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:34.871884 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ca898-bff1-4bdd-867f-debe10d2db7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:34.872700 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ca898-bff1-4bdd-867f-debe10d2db7a None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:34.872979 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ca898-bff1-4bdd-867f-debe10d2db7a None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:34.873250 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ca898-bff1-4bdd-867f-debe10d2db7a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:34.881819 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ca898-bff1-4bdd-867f-debe10d2db7a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:34.883339 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ca898-bff1-4bdd-867f-debe10d2db7a None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:34.889790 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:34.900371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-ce8ca898-bff1-4bdd-867f-debe10d2db7a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 15:03:34.900371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:34.900371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:34.900371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:34.900371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:34.900371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:34.900371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:34.900371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:34.900371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:34.900371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:34.900371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:34.900371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:34.900371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:03:34.900371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:03:34.900371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:03:34.900371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:03:34.901310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:34.901310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:34.901310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:03:34.901310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:34.901310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:03:34.901310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:34.901310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:34.901310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:34.901310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:34.901310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:34.901310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:34.901310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:34.901310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:34.901310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:34.901310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:34.901310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:34.901310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:34.901310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:34.902170 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:34.902170 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:34.902170 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:03:34.902170 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:03:34.902170 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:03:34.902170 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:03:34.902170 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:03:34.902170 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:03:34.902170 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 15:03:34.902170 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:34.902170 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 252/505] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:34.902754 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ca898-bff1-4bdd-867f-debe10d2db7a None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:34.942273 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0fc0e-7ec8-47e1-a053-fd480a666b83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:34.943732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0fc0e-7ec8-47e1-a053-fd480a666b83 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:35.010373 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:35.021127 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ca898-bff1-4bdd-867f-debe10d2db7a None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:35.062518 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 254/506] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:03:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:03:35.063530 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0fc0e-7ec8-47e1-a053-fd480a666b83 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:35.073347 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38a92f-9049-4808-92bd-9f9046c7933e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:35.074743 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38a92f-9049-4808-92bd-9f9046c7933e None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:35.075037 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38a92f-9049-4808-92bd-9f9046c7933e None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:35.075302 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38a92f-9049-4808-92bd-9f9046c7933e None admin] PATH_INFO: `/v3/domains` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:35.076040 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38a92f-9049-4808-92bd-9f9046c7933e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:35.076343 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38a92f-9049-4808-92bd-9f9046c7933e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:35.077736 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38a92f-9049-4808-92bd-9f9046c7933e None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:35.090987 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 253/507] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:35.091849 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38a92f-9049-4808-92bd-9f9046c7933e None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:35.130699 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:35.181696 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0fc0e-7ec8-47e1-a053-fd480a666b83 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:35.206724 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38a92f-9049-4808-92bd-9f9046c7933e None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:35.220858 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4f210-f25c-41cf-801f-f89393520e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:35.221522 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4f210-f25c-41cf-801f-f89393520e87 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:35.221884 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4f210-f25c-41cf-801f-f89393520e87 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:35.222184 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4f210-f25c-41cf-801f-f89393520e87 None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:35.222935 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4f210-f25c-41cf-801f-f89393520e87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:35.223258 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4f210-f25c-41cf-801f-f89393520e87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:35.224631 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4f210-f25c-41cf-801f-f89393520e87 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:35.236641 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 255/508] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:35.238054 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4f210-f25c-41cf-801f-f89393520e87 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:35.244536 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0c9cb-798e-47e0-bb89-b16b8af30f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:35.245218 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0c9cb-798e-47e0-bb89-b16b8af30f49 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:35.245500 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0c9cb-798e-47e0-bb89-b16b8af30f49 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:35.245775 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0c9cb-798e-47e0-bb89-b16b8af30f49 None admin] PATH_INFO: `/v3/users` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:35.246652 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0c9cb-798e-47e0-bb89-b16b8af30f49 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:35.246962 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0c9cb-798e-47e0-bb89-b16b8af30f49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:35.248412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0c9cb-798e-47e0-bb89-b16b8af30f49 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:35.267512 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 254/509] 10.222.0.39 () {56 vars in 1137 bytes} [Wed May 25 15:03:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:35.268358 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0c9cb-798e-47e0-bb89-b16b8af30f49 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:35.286772 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:35.350662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4f210-f25c-41cf-801f-f89393520e87 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:35.368530 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:35.385195 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0c9cb-798e-47e0-bb89-b16b8af30f49 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:35.389585 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c74e50-edc5-4de5-a5c2-935e95313a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:35.390421 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c74e50-edc5-4de5-a5c2-935e95313a44 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:35.390701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c74e50-edc5-4de5-a5c2-935e95313a44 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:35.391062 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c74e50-edc5-4de5-a5c2-935e95313a44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:35.402962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c74e50-edc5-4de5-a5c2-935e95313a44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:35.404456 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c74e50-edc5-4de5-a5c2-935e95313a44 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:35.421591 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-44c74e50-edc5-4de5-a5c2-935e95313a44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:35.421591 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:35.421591 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:35.421591 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:35.421591 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:35.421591 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:35.421591 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:35.421591 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:35.421591 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:35.421591 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:35.421591 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:35.421591 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:35.421591 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:35.421591 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:35.421591 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:35.422493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:35.422493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:35.422493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:35.422493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:35.422493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:35.422493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:35.422493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:35.422493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:35.422493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:35.422493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:35.422493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:35.422493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:35.422493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:35.422493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:35.422493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:35.422493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:35.422493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:35.423670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:35.423670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:35.423670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:35.423670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:35.423670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 256/510] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:35.423946 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c74e50-edc5-4de5-a5c2-935e95313a44 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:35.427016 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7006b81-ec49-4a2b-81bf-e088d940404f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:35.427848 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7006b81-ec49-4a2b-81bf-e088d940404f None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:35.428131 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7006b81-ec49-4a2b-81bf-e088d940404f None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:35.428410 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7006b81-ec49-4a2b-81bf-e088d940404f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:35.436018 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7006b81-ec49-4a2b-81bf-e088d940404f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:35.437508 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7006b81-ec49-4a2b-81bf-e088d940404f None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:35.452695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-a7006b81-ec49-4a2b-81bf-e088d940404f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:35.452695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:35.452695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:35.452695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:35.452695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:35.452695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:35.452695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:35.452695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:35.452695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:35.452695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:35.452695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:35.452695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:35.452695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:03:35.452695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:03:35.452695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:03:35.453742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:03:35.453742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:35.453742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:35.453742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:35.453742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:35.453742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:35.453742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:35.453742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:35.453742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:35.453742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:35.453742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:35.453742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:35.453742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:35.453742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:35.453742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:35.453742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:35.453742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:35.459508 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:03:35.459508 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:03:35.459508 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:03:35.459508 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:03:35.459508 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:03:35.459508 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:03:35.459508 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:35.459508 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:35.459508 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 255/511] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:03:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:35.459508 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7006b81-ec49-4a2b-81bf-e088d940404f None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:35.527729 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:35.538882 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c74e50-edc5-4de5-a5c2-935e95313a44 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:35.565581 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7006b81-ec49-4a2b-81bf-e088d940404f None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:35.575754 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0476df-4ca2-4112-9611-345727aaeb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:35.576574 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0476df-4ca2-4112-9611-345727aaeb19 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:35.576856 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0476df-4ca2-4112-9611-345727aaeb19 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:35.577131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0476df-4ca2-4112-9611-345727aaeb19 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:35.585677 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0476df-4ca2-4112-9611-345727aaeb19 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:35.587177 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0476df-4ca2-4112-9611-345727aaeb19 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:35.598554 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f64c0-b6e2-4594-8c23-aa959e537a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:35.599202 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f64c0-b6e2-4594-8c23-aa959e537a0a None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:35.599482 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f64c0-b6e2-4594-8c23-aa959e537a0a None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:35.599752 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f64c0-b6e2-4594-8c23-aa959e537a0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:35.601898 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-6b0476df-4ca2-4112-9611-345727aaeb19 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 15:03:35.601898 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:35.601898 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:35.601898 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:35.601898 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:35.601898 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:35.601898 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:35.601898 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:35.601898 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:35.601898 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:35.601898 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:35.601898 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:35.601898 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:03:35.601898 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:03:35.601898 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:03:35.601898 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:03:35.602932 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:35.602932 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:35.602932 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:03:35.602932 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:35.602932 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:03:35.602932 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:35.602932 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:35.602932 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:35.602932 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:35.602932 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:35.602932 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:35.602932 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:35.602932 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:35.602932 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:35.602932 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:35.602932 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:35.602932 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:35.602932 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:35.604008 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:35.604008 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:35.604008 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:03:35.604008 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:03:35.604008 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:03:35.604008 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:03:35.604008 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:03:35.604008 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:03:35.604008 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 15:03:35.604008 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:35.604008 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 257/512] 10.222.0.39 () {56 vars in 1102 bytes} [Wed May 25 15:03:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:35.604008 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0476df-4ca2-4112-9611-345727aaeb19 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:35.643223 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:35.674947 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f64c0-b6e2-4594-8c23-aa959e537a0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:35.676449 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f64c0-b6e2-4594-8c23-aa959e537a0a None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:35.744048 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0476df-4ca2-4112-9611-345727aaeb19 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:35.765773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:35.781623 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85b325-e3ac-47ea-91ea-e79ff941d870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:35.782501 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85b325-e3ac-47ea-91ea-e79ff941d870 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:35.782757 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85b325-e3ac-47ea-91ea-e79ff941d870 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:35.783027 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85b325-e3ac-47ea-91ea-e79ff941d870 None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:35.783855 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85b325-e3ac-47ea-91ea-e79ff941d870 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:35.784165 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85b325-e3ac-47ea-91ea-e79ff941d870 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:35.785820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85b325-e3ac-47ea-91ea-e79ff941d870 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:35.798960 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 258/513] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:35.799763 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85b325-e3ac-47ea-91ea-e79ff941d870 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:35.811034 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 256/514] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:03:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:03:35.811034 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f64c0-b6e2-4594-8c23-aa959e537a0a None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:35.895243 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:35.912055 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85b325-e3ac-47ea-91ea-e79ff941d870 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:35.926049 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f64c0-b6e2-4594-8c23-aa959e537a0a None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:35.948654 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afcff3-7e63-4c12-bd2d-1986c721f1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:35.949321 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afcff3-7e63-4c12-bd2d-1986c721f1f3 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:35.949603 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afcff3-7e63-4c12-bd2d-1986c721f1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:35.949875 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afcff3-7e63-4c12-bd2d-1986c721f1f3 None admin] PATH_INFO: `/v3/projects` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:35.950701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6afcff3-7e63-4c12-bd2d-1986c721f1f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:35.951010 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6afcff3-7e63-4c12-bd2d-1986c721f1f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:35.952447 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6afcff3-7e63-4c12-bd2d-1986c721f1f3 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:35.966562 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753f6b8-4477-490e-9e9a-a5e4fd7c410c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:35.967249 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753f6b8-4477-490e-9e9a-a5e4fd7c410c None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:35.967535 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753f6b8-4477-490e-9e9a-a5e4fd7c410c None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:35.967818 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753f6b8-4477-490e-9e9a-a5e4fd7c410c None admin] PATH_INFO: `/v3/users` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:35.968682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753f6b8-4477-490e-9e9a-a5e4fd7c410c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:35.968982 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753f6b8-4477-490e-9e9a-a5e4fd7c410c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:35.970791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753f6b8-4477-490e-9e9a-a5e4fd7c410c None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:35.971242 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 259/515] 10.222.0.39 () {56 vars in 1148 bytes} [Wed May 25 15:03:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:35.972104 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afcff3-7e63-4c12-bd2d-1986c721f1f3 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:36.001613 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 257/516] 10.222.0.39 () {56 vars in 1139 bytes} [Wed May 25 15:03:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:36.001613 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753f6b8-4477-490e-9e9a-a5e4fd7c410c None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:36.030914 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:36.087559 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afcff3-7e63-4c12-bd2d-1986c721f1f3 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:36.116493 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753f6b8-4477-490e-9e9a-a5e4fd7c410c None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:36.127487 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bfb40-3c95-48c4-b29d-bb0bd828e47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:36.128319 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bfb40-3c95-48c4-b29d-bb0bd828e47b None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:36.128600 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bfb40-3c95-48c4-b29d-bb0bd828e47b None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:36.128864 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bfb40-3c95-48c4-b29d-bb0bd828e47b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:36.136102 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bfb40-3c95-48c4-b29d-bb0bd828e47b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:36.137559 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bfb40-3c95-48c4-b29d-bb0bd828e47b None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:36.152582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-151bfb40-3c95-48c4-b29d-bb0bd828e47b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:36.152582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:36.152582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:36.152582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:36.152582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:36.152582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:36.152582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:36.152582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:36.152582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:36.152582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:36.152582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:36.152582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:36.152582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:03:36.152582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:03:36.152582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:03:36.153668 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:03:36.153668 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:36.153668 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:36.153668 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:36.153668 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:36.153668 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:36.153668 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:36.153668 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:36.153668 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:36.153668 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:36.153668 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:36.153668 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:36.153668 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:36.153668 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:36.153668 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:36.153668 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:36.153668 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:36.154564 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:03:36.154564 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:03:36.154564 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:03:36.154564 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:03:36.154564 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:03:36.154564 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:03:36.154564 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:36.154564 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:36.154564 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 260/517] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:03:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:36.155216 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bfb40-3c95-48c4-b29d-bb0bd828e47b None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:36.160943 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac98667-5865-469e-9a5c-9a4bb2e37231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:36.161767 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac98667-5865-469e-9a5c-9a4bb2e37231 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:36.162051 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac98667-5865-469e-9a5c-9a4bb2e37231 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:36.162372 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac98667-5865-469e-9a5c-9a4bb2e37231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:36.164754 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:36.174096 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac98667-5865-469e-9a5c-9a4bb2e37231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:36.175678 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac98667-5865-469e-9a5c-9a4bb2e37231 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:36.194778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-bac98667-5865-469e-9a5c-9a4bb2e37231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:36.194778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:36.194778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:36.194778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:36.194778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:36.194778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:36.194778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:36.194778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:36.194778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:36.194778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:36.194778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:36.194778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:36.194778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:36.194778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:36.194778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:36.195856 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:36.195856 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:36.195856 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:36.195856 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:36.195856 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:36.195856 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:36.195856 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:36.195856 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:36.195856 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:36.195856 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:36.195856 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:36.195856 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:36.195856 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:36.195856 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:36.195856 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:36.195856 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:36.195856 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:36.196851 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:36.196851 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:36.196851 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:36.196851 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:36.200521 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 258/518] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:36.201303 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac98667-5865-469e-9a5c-9a4bb2e37231 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:36.284230 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bfb40-3c95-48c4-b29d-bb0bd828e47b None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:36.299581 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:36.321353 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac98667-5865-469e-9a5c-9a4bb2e37231 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:36.324229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101e63b-37ba-4ff3-8b5b-bb5c556a4882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:36.324900 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101e63b-37ba-4ff3-8b5b-bb5c556a4882 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:36.325177 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101e63b-37ba-4ff3-8b5b-bb5c556a4882 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:36.325447 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101e63b-37ba-4ff3-8b5b-bb5c556a4882 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:36.326309 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101e63b-37ba-4ff3-8b5b-bb5c556a4882 None admin] RBAC: Adding query filter params (role.id=eecb3a0cafcf49b5898e1ca834e110aa, scope.project.id=ff4afc67ebcf4840946ce41755f94bf0, user.id=33f6a22c123f48a09af2f78636a04699) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:36.326616 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101e63b-37ba-4ff3-8b5b-bb5c556a4882 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:36.328088 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101e63b-37ba-4ff3-8b5b-bb5c556a4882 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:36.334666 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 261/519] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:03:36 2022] GET /identity/v3/role_assignments?user.id=33f6a22c123f48a09af2f78636a04699&scope.project.id=ff4afc67ebcf4840946ce41755f94bf0&role.id=eecb3a0cafcf49b5898e1ca834e110aa => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:36.335205 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101e63b-37ba-4ff3-8b5b-bb5c556a4882 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:36.375529 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b978710-07fe-45cd-aa7a-55e526015418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:36.377270 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b978710-07fe-45cd-aa7a-55e526015418 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:36.377934 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b978710-07fe-45cd-aa7a-55e526015418 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:36.377934 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b978710-07fe-45cd-aa7a-55e526015418 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:36.429418 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:36.467494 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b978710-07fe-45cd-aa7a-55e526015418 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:36.469349 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b978710-07fe-45cd-aa7a-55e526015418 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:36.473326 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101e63b-37ba-4ff3-8b5b-bb5c556a4882 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:36.512149 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f740c4-4b4f-49e7-805f-f8cdc5bc261e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:36.512829 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f740c4-4b4f-49e7-805f-f8cdc5bc261e None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:36.513110 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f740c4-4b4f-49e7-805f-f8cdc5bc261e None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:36.513388 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f740c4-4b4f-49e7-805f-f8cdc5bc261e None admin] PATH_INFO: `/v3/projects` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:36.514188 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f740c4-4b4f-49e7-805f-f8cdc5bc261e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:36.514535 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f740c4-4b4f-49e7-805f-f8cdc5bc261e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:36.516015 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f740c4-4b4f-49e7-805f-f8cdc5bc261e None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:36.534838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 262/520] 10.222.0.39 () {56 vars in 1148 bytes} [Wed May 25 15:03:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:36.534838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f740c4-4b4f-49e7-805f-f8cdc5bc261e None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:36.568398 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:36.598912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 259/521] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:03:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:03:36.598912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b978710-07fe-45cd-aa7a-55e526015418 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:36.653268 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f740c4-4b4f-49e7-805f-f8cdc5bc261e None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:36.683352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:36.690685 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67799617-8194-4ce7-a3c6-6b69252ebe6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:36.691370 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67799617-8194-4ce7-a3c6-6b69252ebe6a None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:36.691661 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67799617-8194-4ce7-a3c6-6b69252ebe6a None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:36.691936 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67799617-8194-4ce7-a3c6-6b69252ebe6a None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:36.692665 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67799617-8194-4ce7-a3c6-6b69252ebe6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:36.692980 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67799617-8194-4ce7-a3c6-6b69252ebe6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:36.694388 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67799617-8194-4ce7-a3c6-6b69252ebe6a None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:36.711249 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 263/522] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:36.711249 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67799617-8194-4ce7-a3c6-6b69252ebe6a None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:36.714199 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b978710-07fe-45cd-aa7a-55e526015418 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:36.750636 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50810b95-006e-46bd-b978-e566f61ace17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:36.751942 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50810b95-006e-46bd-b978-e566f61ace17 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:36.752237 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50810b95-006e-46bd-b978-e566f61ace17 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:36.752514 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50810b95-006e-46bd-b978-e566f61ace17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:36.753346 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50810b95-006e-46bd-b978-e566f61ace17 None admin] RBAC: Adding query filter params (role.id=eecb3a0cafcf49b5898e1ca834e110aa, scope.project.id=ff4afc67ebcf4840946ce41755f94bf0, user.id=2b488bcd5ddc427fbdf78d56793a2035) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:36.753657 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50810b95-006e-46bd-b978-e566f61ace17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:36.755128 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50810b95-006e-46bd-b978-e566f61ace17 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:36.761088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 260/523] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:03:36 2022] GET /identity/v3/role_assignments?user.id=2b488bcd5ddc427fbdf78d56793a2035&scope.project.id=ff4afc67ebcf4840946ce41755f94bf0&role.id=eecb3a0cafcf49b5898e1ca834e110aa => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:36.762302 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50810b95-006e-46bd-b978-e566f61ace17 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:36.825134 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:36.851373 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67799617-8194-4ce7-a3c6-6b69252ebe6a None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:36.894770 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d82576-7c74-410c-ab52-c1b773b39c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:36.896019 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d82576-7c74-410c-ab52-c1b773b39c07 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:36.896647 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d82576-7c74-410c-ab52-c1b773b39c07 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:36.897118 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d82576-7c74-410c-ab52-c1b773b39c07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:36.910954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d82576-7c74-410c-ab52-c1b773b39c07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:36.911606 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50810b95-006e-46bd-b978-e566f61ace17 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:36.913069 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d82576-7c74-410c-ab52-c1b773b39c07 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:36.934038 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-a2d82576-7c74-410c-ab52-c1b773b39c07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:36.934038 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:36.934038 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:36.934038 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:36.934038 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:36.934038 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:36.934038 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:36.934038 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:36.934038 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:36.934038 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:36.934038 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:36.934038 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:36.934038 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:36.934038 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:36.934038 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:36.935228 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:36.935228 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:36.935228 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:36.935228 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:36.935228 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:36.935228 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:36.935228 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:36.935228 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:36.935228 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:36.935228 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:36.935228 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:36.935228 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:36.935228 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:36.935228 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:36.935228 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:36.935228 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:36.935228 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:36.936273 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:36.936273 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:36.936273 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:36.936273 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:36.942790 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 264/524] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:36.945929 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d82576-7c74-410c-ab52-c1b773b39c07 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:36.956753 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e257997-5fd4-4ad4-a1d5-07252fb9460b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:36.957925 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e257997-5fd4-4ad4-a1d5-07252fb9460b None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:36.958216 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e257997-5fd4-4ad4-a1d5-07252fb9460b None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:36.958525 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e257997-5fd4-4ad4-a1d5-07252fb9460b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:36.969253 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e257997-5fd4-4ad4-a1d5-07252fb9460b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:36.971318 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e257997-5fd4-4ad4-a1d5-07252fb9460b None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:36.990298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-6e257997-5fd4-4ad4-a1d5-07252fb9460b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:36.990298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:36.990298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:36.990298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:36.990298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:36.990298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:36.990298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:36.990298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:36.990298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:36.990298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:36.990298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:36.990298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:36.990298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:03:36.990298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:03:36.990298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:03:36.991322 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:03:36.991322 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:36.991322 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:36.991322 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:36.991322 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:36.991322 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:36.991322 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:36.991322 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:36.991322 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:36.991322 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:36.991322 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:36.991322 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:36.991322 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:36.991322 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:36.991322 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:36.991322 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:36.991322 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:36.992143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:03:36.992143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:03:36.992143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:03:36.992143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:03:36.992143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:03:36.992143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:03:36.992143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:36.992143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:36.992143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 261/525] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:03:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:36.997335 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e257997-5fd4-4ad4-a1d5-07252fb9460b None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:37.026658 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:37.096064 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d82576-7c74-410c-ab52-c1b773b39c07 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:37.131438 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e257997-5fd4-4ad4-a1d5-07252fb9460b None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:37.133825 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f610c8e-a9a1-4e42-9063-229b06f80e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:37.134438 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:37.135319 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f610c8e-a9a1-4e42-9063-229b06f80e32 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:37.135848 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f610c8e-a9a1-4e42-9063-229b06f80e32 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:37.136539 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f610c8e-a9a1-4e42-9063-229b06f80e32 None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:37.137647 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f610c8e-a9a1-4e42-9063-229b06f80e32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:37.138179 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f610c8e-a9a1-4e42-9063-229b06f80e32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:37.140210 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f610c8e-a9a1-4e42-9063-229b06f80e32 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:37.155469 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 265/526] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:37.161640 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f610c8e-a9a1-4e42-9063-229b06f80e32 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:37.180708 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c381e-2507-45c0-a491-b908d2d61503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:37.181683 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c381e-2507-45c0-a491-b908d2d61503 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:37.182321 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c381e-2507-45c0-a491-b908d2d61503 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:37.182605 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c381e-2507-45c0-a491-b908d2d61503 None admin] PATH_INFO: `/v3/projects` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:37.183432 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c381e-2507-45c0-a491-b908d2d61503 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:37.183752 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c381e-2507-45c0-a491-b908d2d61503 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:37.186029 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c381e-2507-45c0-a491-b908d2d61503 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:37.209858 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 262/527] 10.222.0.39 () {56 vars in 1148 bytes} [Wed May 25 15:03:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:37.216015 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c381e-2507-45c0-a491-b908d2d61503 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:37.293882 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f610c8e-a9a1-4e42-9063-229b06f80e32 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:37.295835 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:37.347657 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc406dc6-9f25-418a-943b-a1f28d37d191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:37.348526 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc406dc6-9f25-418a-943b-a1f28d37d191 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:37.348776 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc406dc6-9f25-418a-943b-a1f28d37d191 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:37.349054 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc406dc6-9f25-418a-943b-a1f28d37d191 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:37.353195 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c381e-2507-45c0-a491-b908d2d61503 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:37.357035 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc406dc6-9f25-418a-943b-a1f28d37d191 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:37.358528 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc406dc6-9f25-418a-943b-a1f28d37d191 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:37.381827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-bc406dc6-9f25-418a-943b-a1f28d37d191 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:37.381827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:37.381827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:37.381827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:37.381827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:37.381827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:37.381827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:37.381827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:37.381827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:37.381827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:37.381827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:37.381827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:37.381827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:03:37.381827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:03:37.381827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:03:37.382779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:03:37.382779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:37.382779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:37.382779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:37.382779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:37.382779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:37.382779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:37.382779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:37.382779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:37.382779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:37.382779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:37.382779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:37.382779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:37.382779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:37.382779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:37.382779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:37.382779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:37.383697 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:03:37.383697 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:03:37.383697 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:03:37.383697 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:03:37.383697 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:03:37.383697 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:03:37.383697 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:37.383697 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:37.389052 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 266/528] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:03:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:03:37.390207 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc406dc6-9f25-418a-943b-a1f28d37d191 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:37.411038 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a744627-1524-4345-9799-26629bfcc25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:37.412147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a744627-1524-4345-9799-26629bfcc25e None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:37.412658 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a744627-1524-4345-9799-26629bfcc25e None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:37.413159 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a744627-1524-4345-9799-26629bfcc25e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:37.414266 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a744627-1524-4345-9799-26629bfcc25e None admin] RBAC: Adding query filter params (role.id=eecb3a0cafcf49b5898e1ca834e110aa, scope.project.id=ff4afc67ebcf4840946ce41755f94bf0, user.id=57fc08f3464a47faac6390af7bd8a680) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:37.414810 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a744627-1524-4345-9799-26629bfcc25e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:37.416511 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a744627-1524-4345-9799-26629bfcc25e None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:37.423779 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 263/529] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:03:37 2022] GET /identity/v3/role_assignments?user.id=57fc08f3464a47faac6390af7bd8a680&scope.project.id=ff4afc67ebcf4840946ce41755f94bf0&role.id=eecb3a0cafcf49b5898e1ca834e110aa => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:37.532940 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc406dc6-9f25-418a-943b-a1f28d37d191 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:37.593355 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8bc42-2e7f-44bb-b222-b7fa7dfba433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:37.594888 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8bc42-2e7f-44bb-b222-b7fa7dfba433 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:37.595799 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8bc42-2e7f-44bb-b222-b7fa7dfba433 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:37.596390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8bc42-2e7f-44bb-b222-b7fa7dfba433 None admin] PATH_INFO: `/v3/projects` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:37.598114 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8bc42-2e7f-44bb-b222-b7fa7dfba433 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:37.598753 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8bc42-2e7f-44bb-b222-b7fa7dfba433 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:37.601656 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8bc42-2e7f-44bb-b222-b7fa7dfba433 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:37.627261 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 267/530] 10.222.0.39 () {56 vars in 1148 bytes} [Wed May 25 15:03:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:37.635448 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a744627-1524-4345-9799-26629bfcc25e None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:37.673979 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:37.752808 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a744627-1524-4345-9799-26629bfcc25e None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:37.788641 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a6505-d47e-4fae-b29f-337357e36839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:37.789306 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a6505-d47e-4fae-b29f-337357e36839 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:37.789585 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a6505-d47e-4fae-b29f-337357e36839 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:37.789854 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a6505-d47e-4fae-b29f-337357e36839 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:37.790702 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a6505-d47e-4fae-b29f-337357e36839 None admin] RBAC: Adding query filter params (role.id=eecb3a0cafcf49b5898e1ca834e110aa, scope.project.id=ff4afc67ebcf4840946ce41755f94bf0, user.id=f22ed37eb4a04bd4ad58739434623a48) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:37.791006 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a6505-d47e-4fae-b29f-337357e36839 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:37.792500 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a6505-d47e-4fae-b29f-337357e36839 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:37.799094 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 264/531] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:03:37 2022] GET /identity/v3/role_assignments?user.id=f22ed37eb4a04bd4ad58739434623a48&scope.project.id=ff4afc67ebcf4840946ce41755f94bf0&role.id=eecb3a0cafcf49b5898e1ca834e110aa => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:38.739578 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc20c46-c891-4a7c-a129-d158c8c31014 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:38.740259 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc20c46-c891-4a7c-a129-d158c8c31014 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:38.740259 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc20c46-c891-4a7c-a129-d158c8c31014 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:38.741850 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 268/532] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:38.747736 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba472d-d5af-42bf-b252-0ef930331d0a None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:38.748354 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba472d-d5af-42bf-b252-0ef930331d0a None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:38.748354 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba472d-d5af-42bf-b252-0ef930331d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:38.766849 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-01ba472d-d5af-42bf-b252-0ef930331d0a None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:38.768154 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-01ba472d-d5af-42bf-b252-0ef930331d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:38.843275 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 265/533] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:38.866380 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc20c46-c891-4a7c-a129-d158c8c31014 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:38.892393 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:38.989063 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc20c46-c891-4a7c-a129-d158c8c31014 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:39.024598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da0f2f-68e3-475e-83c4-6824293d86a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:39.025331 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da0f2f-68e3-475e-83c4-6824293d86a8 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:39.025610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da0f2f-68e3-475e-83c4-6824293d86a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:39.025882 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da0f2f-68e3-475e-83c4-6824293d86a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:39.037128 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da0f2f-68e3-475e-83c4-6824293d86a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:39.045175 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-e5da0f2f-68e3-475e-83c4-6824293d86a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:39.045175 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:39.045175 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:39.045175 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:39.045175 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:39.045175 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:39.045175 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:39.045175 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:39.045175 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:39.045175 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:39.045175 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:39.045175 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:39.045175 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:39.045175 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:39.045175 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:39.045175 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:39.046112 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:39.046112 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:39.046112 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:39.046112 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:39.046112 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:39.046112 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:39.046112 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:39.046112 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:39.046112 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:39.046112 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:39.046112 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:39.046112 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:39.046112 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:39.046112 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:39.046112 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:39.046112 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:39.047426 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:39.047426 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:39.047426 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:39.047426 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:39.047426 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:39.047426 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:39.047426 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:39.047426 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:39.047426 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:39.047426 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:39.047426 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:39.047426 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:39.047426 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 269/534] 10.222.0.39 () {56 vars in 1102 bytes} [Wed May 25 15:03:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:39.054880 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba472d-d5af-42bf-b252-0ef930331d0a None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:39.083857 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:39.123128 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621d542-64f5-4de1-a768-66bbab4ebd7d None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:39.123460 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621d542-64f5-4de1-a768-66bbab4ebd7d None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:39.123687 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621d542-64f5-4de1-a768-66bbab4ebd7d None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:39.125315 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 270/535] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:39.130814 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b736b2-0e37-4c4b-884a-79dd2b2dd545 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:39.131098 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b736b2-0e37-4c4b-884a-79dd2b2dd545 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:39.131370 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b736b2-0e37-4c4b-884a-79dd2b2dd545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:39.148467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-60b736b2-0e37-4c4b-884a-79dd2b2dd545 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:39.149663 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-60b736b2-0e37-4c4b-884a-79dd2b2dd545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:39.173612 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba472d-d5af-42bf-b252-0ef930331d0a None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:39.212079 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894acf80-6803-44a3-9a77-ca5883827525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:39.212767 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894acf80-6803-44a3-9a77-ca5883827525 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:39.213053 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894acf80-6803-44a3-9a77-ca5883827525 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:39.213327 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894acf80-6803-44a3-9a77-ca5883827525 None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:39.214180 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894acf80-6803-44a3-9a77-ca5883827525 None admin] RBAC: Adding query filter params (name=service) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:39.214540 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894acf80-6803-44a3-9a77-ca5883827525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:39.216032 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894acf80-6803-44a3-9a77-ca5883827525 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:39.225617 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 266/537] 10.222.0.39 () {56 vars in 1103 bytes} [Wed May 25 15:03:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:39.226381 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 271/537] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:03:39.232755 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894acf80-6803-44a3-9a77-ca5883827525 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:39.246078 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b736b2-0e37-4c4b-884a-79dd2b2dd545 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:39.261533 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:39.339851 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:39.357896 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894acf80-6803-44a3-9a77-ca5883827525 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:39.359059 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b736b2-0e37-4c4b-884a-79dd2b2dd545 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:39.397827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcc957-fdf1-4422-b83f-0cd59d5bb6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:39.398165 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f0af9-916e-4d97-a9a2-7e1732f579a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:39.398976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcc957-fdf1-4422-b83f-0cd59d5bb6e2 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:39.399113 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f0af9-916e-4d97-a9a2-7e1732f579a0 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:39.399354 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f0af9-916e-4d97-a9a2-7e1732f579a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:39.399509 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcc957-fdf1-4422-b83f-0cd59d5bb6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:39.399636 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f0af9-916e-4d97-a9a2-7e1732f579a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:39.399954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcc957-fdf1-4422-b83f-0cd59d5bb6e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:39.413477 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f0af9-916e-4d97-a9a2-7e1732f579a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:39.414047 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bcc957-fdf1-4422-b83f-0cd59d5bb6e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:39.415078 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f0af9-916e-4d97-a9a2-7e1732f579a0 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:39.423229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-16bcc957-fdf1-4422-b83f-0cd59d5bb6e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:39.423229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:39.423229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:39.423229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:39.423229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:39.423229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:39.423229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:39.423229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:39.423229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:39.423229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:39.423229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:39.423229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:39.423229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:39.423229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:39.423229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:39.423229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:39.424239 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:39.424239 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:39.424239 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:39.424239 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:39.424239 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:39.424239 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:39.424239 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:39.424239 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:39.424239 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:39.424239 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:39.424239 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:39.424239 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:39.424239 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:39.424239 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:39.424239 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:39.424239 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:39.425011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:39.425011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:39.425011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:39.425011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:39.425011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:39.425011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:39.425011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:39.425011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:39.425011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:39.425011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:39.425011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:39.425011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:39.425649 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 272/538] 10.222.0.39 () {56 vars in 1102 bytes} [Wed May 25 15:03:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:39.431573 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcc957-fdf1-4422-b83f-0cd59d5bb6e2 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:39.434191 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-195f0af9-916e-4d97-a9a2-7e1732f579a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:39.434191 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:39.434191 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:39.434191 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:39.434191 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:39.434191 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:39.434191 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:39.434191 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:39.434191 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:39.434191 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:39.434191 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:39.434191 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:39.434191 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:39.434191 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:39.434191 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:39.435044 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:39.435044 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:39.435044 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:39.435044 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:39.435044 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:39.435044 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:39.435044 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:39.435044 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:39.435044 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:39.435044 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:39.435044 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:39.435044 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:39.435044 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:39.435044 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:39.435044 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:39.435044 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:39.435044 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:39.435862 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:39.435862 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:39.435862 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:39.435862 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:39.440546 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 267/539] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:39.441682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f0af9-916e-4d97-a9a2-7e1732f579a0 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:39.533429 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:39.567326 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f0af9-916e-4d97-a9a2-7e1732f579a0 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:39.580873 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcc957-fdf1-4422-b83f-0cd59d5bb6e2 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:39.619332 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3adc8f-3ed5-4be9-be82-c4c59c490bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:39.619946 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3adc8f-3ed5-4be9-be82-c4c59c490bd8 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:39.620232 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3adc8f-3ed5-4be9-be82-c4c59c490bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:39.620574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3adc8f-3ed5-4be9-be82-c4c59c490bd8 None admin] PATH_INFO: `/v3/domains` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:39.621364 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3adc8f-3ed5-4be9-be82-c4c59c490bd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:39.621699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3adc8f-3ed5-4be9-be82-c4c59c490bd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:39.623229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3adc8f-3ed5-4be9-be82-c4c59c490bd8 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:39.624528 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c20590-1b8f-4ca5-83bc-9b451a314c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:39.625717 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c20590-1b8f-4ca5-83bc-9b451a314c45 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:39.626642 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c20590-1b8f-4ca5-83bc-9b451a314c45 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:39.626923 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c20590-1b8f-4ca5-83bc-9b451a314c45 None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:39.627186 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:39.627965 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c20590-1b8f-4ca5-83bc-9b451a314c45 None admin] RBAC: Adding query filter params (name=service) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:39.627965 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c20590-1b8f-4ca5-83bc-9b451a314c45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:39.629372 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c20590-1b8f-4ca5-83bc-9b451a314c45 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:39.644723 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 273/540] 10.222.0.39 () {56 vars in 1103 bytes} [Wed May 25 15:03:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:39.646007 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c20590-1b8f-4ca5-83bc-9b451a314c45 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:39.650199 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 268/541] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:39.655630 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3adc8f-3ed5-4be9-be82-c4c59c490bd8 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:39.782653 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3adc8f-3ed5-4be9-be82-c4c59c490bd8 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:39.795225 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c20590-1b8f-4ca5-83bc-9b451a314c45 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:39.838261 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2b67a-8f4d-4c65-bfb2-9e8fe221d912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:39.839398 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2b67a-8f4d-4c65-bfb2-9e8fe221d912 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:39.839829 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2b67a-8f4d-4c65-bfb2-9e8fe221d912 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:39.840248 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2b67a-8f4d-4c65-bfb2-9e8fe221d912 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:39.842818 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:39.854589 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2b67a-8f4d-4c65-bfb2-9e8fe221d912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:39.856326 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2b67a-8f4d-4c65-bfb2-9e8fe221d912 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:39.876329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-c8f2b67a-8f4d-4c65-bfb2-9e8fe221d912 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:39.876329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:39.876329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:39.876329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:39.876329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:39.876329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:39.876329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:39.876329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:39.876329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:39.876329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:39.876329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:39.876329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:39.876329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:39.876329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:39.876329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:39.877211 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:39.877211 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:39.877211 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:39.877211 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:39.877211 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:39.877211 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:39.877211 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:39.877211 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:39.877211 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:39.877211 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:39.877211 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:39.877211 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:39.877211 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:39.877211 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:39.877211 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:39.877211 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:39.877211 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:39.878043 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:39.878043 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:39.878043 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:39.878043 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:39.884607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 274/542] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:03:39.885872 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2b67a-8f4d-4c65-bfb2-9e8fe221d912 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:39.950845 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9b39b-be44-4938-b2ac-e12a287d0771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:39.951957 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9b39b-be44-4938-b2ac-e12a287d0771 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:39.952238 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9b39b-be44-4938-b2ac-e12a287d0771 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:39.952514 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9b39b-be44-4938-b2ac-e12a287d0771 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:39.961664 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9b39b-be44-4938-b2ac-e12a287d0771 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:39.963210 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9b39b-be44-4938-b2ac-e12a287d0771 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:39.979699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-dba9b39b-be44-4938-b2ac-e12a287d0771 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 15:03:39.979699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:39.979699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:39.979699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:39.979699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:39.979699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:39.979699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:39.979699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:39.979699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:39.979699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:39.979699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:39.979699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:39.979699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:03:39.979699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:03:39.979699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:03:39.979699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:03:39.985836 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:39.985836 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:39.985836 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:03:39.985836 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:39.985836 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:03:39.985836 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:39.985836 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:39.985836 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:39.985836 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:39.985836 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:39.985836 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:39.985836 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:39.985836 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:39.985836 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:39.985836 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:39.985836 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:39.985836 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:39.985836 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:39.986794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:39.986794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:39.986794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:03:39.986794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:03:39.986794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:03:39.986794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:03:39.986794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:03:39.986794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:03:39.986794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 15:03:39.986794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:39.986794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 269/543] 10.222.0.39 () {56 vars in 1093 bytes} [Wed May 25 15:03:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:03:39.986794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31525f7a-e920-4890-a791-846574f5e688 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:39.986794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31525f7a-e920-4890-a791-846574f5e688 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:39.987466 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31525f7a-e920-4890-a791-846574f5e688 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:39.987466 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 270/544] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:39.988827 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31525f7a-e920-4890-a791-846574f5e688 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:40.010889 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2b67a-8f4d-4c65-bfb2-9e8fe221d912 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:40.055312 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704c597-a024-4cba-be60-8a1ccca50d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:40.055643 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:40.056641 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704c597-a024-4cba-be60-8a1ccca50d79 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:40.057240 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704c597-a024-4cba-be60-8a1ccca50d79 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:40.057780 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704c597-a024-4cba-be60-8a1ccca50d79 None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:40.058568 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704c597-a024-4cba-be60-8a1ccca50d79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:40.058881 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704c597-a024-4cba-be60-8a1ccca50d79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:40.060797 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704c597-a024-4cba-be60-8a1ccca50d79 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:40.075702 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 275/545] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:40.077369 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338e95b-237b-485b-97e5-da5d99145d71 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:40.077876 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338e95b-237b-485b-97e5-da5d99145d71 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:40.078380 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338e95b-237b-485b-97e5-da5d99145d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:40.096946 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-3338e95b-237b-485b-97e5-da5d99145d71 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:40.098156 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-3338e95b-237b-485b-97e5-da5d99145d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:40.107129 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31525f7a-e920-4890-a791-846574f5e688 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:40.145300 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53739d4b-eeba-414c-9694-602c15f20cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:40.145917 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53739d4b-eeba-414c-9694-602c15f20cdd None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:40.146205 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53739d4b-eeba-414c-9694-602c15f20cdd None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:40.146515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53739d4b-eeba-414c-9694-602c15f20cdd None admin] PATH_INFO: `/v3/users` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:40.146991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:40.147878 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53739d4b-eeba-414c-9694-602c15f20cdd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:40.148071 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53739d4b-eeba-414c-9694-602c15f20cdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:40.149926 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53739d4b-eeba-414c-9694-602c15f20cdd None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:40.169407 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 271/546] 10.222.0.39 () {56 vars in 1133 bytes} [Wed May 25 15:03:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:40.170637 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53739d4b-eeba-414c-9694-602c15f20cdd None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:40.173326 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 276/547] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:40.174690 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f30a28-ccca-4eef-8a17-6506b84e8946 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:40.174978 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f30a28-ccca-4eef-8a17-6506b84e8946 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:40.175251 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f30a28-ccca-4eef-8a17-6506b84e8946 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:40.176595 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 277/548] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:40.177215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f30a28-ccca-4eef-8a17-6506b84e8946 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:40.276967 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53739d4b-eeba-414c-9694-602c15f20cdd None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:40.284819 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f30a28-ccca-4eef-8a17-6506b84e8946 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:40.291577 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:40.313955 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f5cc0-9b8b-4289-a5db-a31437488db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:40.314894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f5cc0-9b8b-4289-a5db-a31437488db3 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:40.315173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f5cc0-9b8b-4289-a5db-a31437488db3 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:40.315466 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f5cc0-9b8b-4289-a5db-a31437488db3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:40.321240 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac48faf-f0c5-41dc-a824-c23b77f2e214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:40.322047 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac48faf-f0c5-41dc-a824-c23b77f2e214 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:40.322360 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac48faf-f0c5-41dc-a824-c23b77f2e214 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:40.322634 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac48faf-f0c5-41dc-a824-c23b77f2e214 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:40.322873 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f5cc0-9b8b-4289-a5db-a31437488db3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:40.324332 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f5cc0-9b8b-4289-a5db-a31437488db3 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:40.333459 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac48faf-f0c5-41dc-a824-c23b77f2e214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:40.334990 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac48faf-f0c5-41dc-a824-c23b77f2e214 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:40.339098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-b29f5cc0-9b8b-4289-a5db-a31437488db3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 15:03:40.339098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:40.339098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:40.339098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:40.339098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:40.339098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:40.339098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:40.339098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:40.339098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:40.339098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:40.339098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:40.339098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:40.339098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:03:40.339098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:03:40.339098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:03:40.339098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:03:40.340168 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:40.340168 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:40.340168 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:03:40.340168 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:40.340168 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:03:40.340168 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:40.340168 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:40.340168 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:40.340168 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:40.340168 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:40.340168 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:40.340168 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:40.340168 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:40.340168 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:40.340168 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:40.340168 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:40.340168 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:40.340168 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:40.341040 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:40.341040 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:40.341040 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:03:40.341040 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:03:40.341040 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:03:40.341040 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:03:40.341040 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:03:40.341040 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:03:40.341040 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 15:03:40.341040 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:40.341040 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 272/549] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:40.341603 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb0461-9d78-4e17-b4cb-ab203e3bf49c None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:40.341860 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb0461-9d78-4e17-b4cb-ab203e3bf49c None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:40.342106 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb0461-9d78-4e17-b4cb-ab203e3bf49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:40.365483 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-f9fb0461-9d78-4e17-b4cb-ab203e3bf49c None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:40.367304 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-f9fb0461-9d78-4e17-b4cb-ab203e3bf49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:40.452260 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 273/550] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:40.453061 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb0461-9d78-4e17-b4cb-ab203e3bf49c None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:40.479499 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-1ac48faf-f0c5-41dc-a824-c23b77f2e214 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:40.479499 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:40.479499 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:40.479499 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:40.479499 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:40.479499 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:40.479499 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:40.479499 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:40.479499 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:40.479499 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:40.479499 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:40.479499 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:40.479499 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:40.479499 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:40.479499 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:40.480598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:40.480598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:40.480598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:40.480598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:40.480598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:40.480598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:40.480598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:40.480598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:40.480598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:40.480598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:40.480598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:40.480598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:40.480598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:40.480598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:40.480598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:40.480598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:40.480598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:40.481459 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:40.481459 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:40.481459 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:40.481459 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:40.481459 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 278/551] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:40.482204 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac48faf-f0c5-41dc-a824-c23b77f2e214 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:40.511294 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:40.562006 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb0461-9d78-4e17-b4cb-ab203e3bf49c None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:40.565451 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:40.585752 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac48faf-f0c5-41dc-a824-c23b77f2e214 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:40.598127 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f19fce-e2ce-445e-871e-8aa10dfdf9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:40.599032 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f19fce-e2ce-445e-871e-8aa10dfdf9a0 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:40.599318 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f19fce-e2ce-445e-871e-8aa10dfdf9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:40.599594 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f19fce-e2ce-445e-871e-8aa10dfdf9a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:40.610951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f19fce-e2ce-445e-871e-8aa10dfdf9a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:40.619025 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-64f19fce-e2ce-445e-871e-8aa10dfdf9a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:40.619025 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:40.619025 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:40.619025 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:40.619025 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:40.619025 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:40.619025 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:40.619025 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:40.619025 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:40.619025 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:40.619025 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:40.619025 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:40.619025 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:40.619025 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:40.619025 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:40.619025 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:40.620217 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:40.620217 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:40.620217 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:40.620217 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:40.620217 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:40.620217 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:40.620217 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:40.620217 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:40.620217 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:40.620217 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:40.620217 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:40.620217 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:40.620217 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:40.620217 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:40.620217 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:40.620217 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:40.621036 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:40.621036 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:40.621036 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:40.621036 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:40.621036 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:40.621036 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:40.621036 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:40.621036 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:40.621036 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:40.621036 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:40.621036 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:40.621036 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:40.621036 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 274/552] 10.222.0.39 () {56 vars in 1102 bytes} [Wed May 25 15:03:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:40.621705 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f19fce-e2ce-445e-871e-8aa10dfdf9a0 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:40.623425 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6863d6-3b6f-4dc1-afba-6bb9479f149e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:40.624113 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6863d6-3b6f-4dc1-afba-6bb9479f149e None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:40.624394 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6863d6-3b6f-4dc1-afba-6bb9479f149e None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:40.624668 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6863d6-3b6f-4dc1-afba-6bb9479f149e None admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:40.625518 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6863d6-3b6f-4dc1-afba-6bb9479f149e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:40.625990 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6863d6-3b6f-4dc1-afba-6bb9479f149e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:40.627530 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6863d6-3b6f-4dc1-afba-6bb9479f149e None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:40.664136 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 279/553] 10.222.0.39 () {56 vars in 1137 bytes} [Wed May 25 15:03:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:40.664996 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6863d6-3b6f-4dc1-afba-6bb9479f149e None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:40.730995 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f19fce-e2ce-445e-871e-8aa10dfdf9a0 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:40.754035 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:40.765508 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e752ab-4b04-478c-b230-0cd9a9f78bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:40.766400 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e752ab-4b04-478c-b230-0cd9a9f78bda None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:40.766833 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e752ab-4b04-478c-b230-0cd9a9f78bda None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:40.767172 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e752ab-4b04-478c-b230-0cd9a9f78bda None admin] PATH_INFO: `/v3/roles/service` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:40.770767 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6863d6-3b6f-4dc1-afba-6bb9479f149e None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:40.777693 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e752ab-4b04-478c-b230-0cd9a9f78bda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:40.785673 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-60e752ab-4b04-478c-b230-0cd9a9f78bda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:40.785673 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:40.785673 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:40.785673 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:40.785673 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:40.785673 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:40.785673 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:40.785673 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:40.785673 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:40.785673 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:40.785673 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:40.785673 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:40.785673 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:40.785673 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:40.785673 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:40.785673 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:40.787309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:40.787309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:40.787309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:40.787309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:40.787309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:40.787309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:40.787309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:40.787309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:40.787309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:40.787309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:40.787309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:40.787309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:40.787309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:40.787309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:40.787309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:40.787309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:40.788130 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:40.788130 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:40.788130 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:40.788130 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:40.788130 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:40.788130 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:40.788130 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:40.788130 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:40.788130 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:40.788130 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:40.788130 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:40.788130 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:40.788130 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 275/554] 10.222.0.39 () {56 vars in 1102 bytes} [Wed May 25 15:03:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:40.788130 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e752ab-4b04-478c-b230-0cd9a9f78bda None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:40.814270 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27d80a-53f6-4c20-8840-a171fb9b839c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:40.814872 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:40.814990 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27d80a-53f6-4c20-8840-a171fb9b839c None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:40.815233 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27d80a-53f6-4c20-8840-a171fb9b839c None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:40.815495 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27d80a-53f6-4c20-8840-a171fb9b839c None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:40.816349 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27d80a-53f6-4c20-8840-a171fb9b839c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:40.816645 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27d80a-53f6-4c20-8840-a171fb9b839c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:40.818195 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27d80a-53f6-4c20-8840-a171fb9b839c None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:40.829702 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 280/555] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:40.830558 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27d80a-53f6-4c20-8840-a171fb9b839c None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:40.898046 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e752ab-4b04-478c-b230-0cd9a9f78bda None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:40.931671 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27d80a-53f6-4c20-8840-a171fb9b839c None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:40.932452 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe160ef-ba5a-4e3b-b3c4-e10744eeb56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:40.933139 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe160ef-ba5a-4e3b-b3c4-e10744eeb56e None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:40.933414 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe160ef-ba5a-4e3b-b3c4-e10744eeb56e None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:40.933688 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe160ef-ba5a-4e3b-b3c4-e10744eeb56e None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:40.934470 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe160ef-ba5a-4e3b-b3c4-e10744eeb56e None admin] RBAC: Adding query filter params (name=service) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:40.934781 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe160ef-ba5a-4e3b-b3c4-e10744eeb56e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:40.936172 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe160ef-ba5a-4e3b-b3c4-e10744eeb56e None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:40.944791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 276/556] 10.222.0.39 () {56 vars in 1103 bytes} [Wed May 25 15:03:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:40.945658 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe160ef-ba5a-4e3b-b3c4-e10744eeb56e None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:40.974007 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d505f24-8e27-4825-a7b5-70c363731dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:40.974895 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d505f24-8e27-4825-a7b5-70c363731dd9 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:40.975177 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d505f24-8e27-4825-a7b5-70c363731dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:40.975453 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d505f24-8e27-4825-a7b5-70c363731dd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:40.986780 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d505f24-8e27-4825-a7b5-70c363731dd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:40.988160 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d505f24-8e27-4825-a7b5-70c363731dd9 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:40.994877 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:41.006783 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-1d505f24-8e27-4825-a7b5-70c363731dd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:41.006783 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:41.006783 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:41.006783 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:41.006783 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:41.006783 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:41.006783 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:41.006783 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:41.006783 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:41.006783 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:41.006783 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:41.006783 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:41.006783 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:41.006783 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:41.006783 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:41.007707 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:41.007707 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:41.007707 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:41.007707 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:41.007707 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:41.007707 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:41.007707 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:41.007707 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:41.007707 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:41.007707 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:41.007707 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:41.007707 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:41.007707 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:41.007707 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:41.007707 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:41.007707 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:41.007707 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:41.008556 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:41.008556 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:41.008556 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:41.008556 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:41.008556 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 281/557] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:41.008819 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d505f24-8e27-4825-a7b5-70c363731dd9 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:41.041397 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:41.057284 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe160ef-ba5a-4e3b-b3c4-e10744eeb56e None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:41.099658 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01f80d-685e-4b0b-b767-75a539d604dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:41.100339 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01f80d-685e-4b0b-b767-75a539d604dd None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:41.100663 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01f80d-685e-4b0b-b767-75a539d604dd None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:41.100945 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01f80d-685e-4b0b-b767-75a539d604dd None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:41.101698 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c01f80d-685e-4b0b-b767-75a539d604dd None admin] RBAC: Adding query filter params (name=service) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:41.102010 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c01f80d-685e-4b0b-b767-75a539d604dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:41.103448 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c01f80d-685e-4b0b-b767-75a539d604dd None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:41.113295 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 277/558] 10.222.0.39 () {56 vars in 1103 bytes} [Wed May 25 15:03:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:41.114157 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01f80d-685e-4b0b-b767-75a539d604dd None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:41.131009 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d505f24-8e27-4825-a7b5-70c363731dd9 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:41.168327 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb59bd-5c39-415e-a504-40ca72d4de43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:41.169230 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb59bd-5c39-415e-a504-40ca72d4de43 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:41.169508 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb59bd-5c39-415e-a504-40ca72d4de43 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:41.169776 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb59bd-5c39-415e-a504-40ca72d4de43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:41.177704 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb59bd-5c39-415e-a504-40ca72d4de43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:41.179173 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb59bd-5c39-415e-a504-40ca72d4de43 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:41.193976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-f9fb59bd-5c39-415e-a504-40ca72d4de43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:41.193976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:41.193976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:41.193976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:41.193976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:41.193976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:41.193976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:41.193976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:41.193976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:41.193976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:41.193976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:41.193976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:41.193976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:03:41.193976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:03:41.193976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:03:41.195467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:03:41.195467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:41.195467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:41.195467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:41.195467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:41.195467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:41.195467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:41.195467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:41.195467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:41.195467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:41.195467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:41.195467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:41.195467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:41.195467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:41.195467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:41.195467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:41.195467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:41.196325 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:03:41.196325 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:03:41.196325 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:03:41.196325 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:03:41.196325 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:03:41.196325 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:03:41.196325 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:41.196325 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:41.196325 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 282/559] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:03:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:41.196325 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb59bd-5c39-415e-a504-40ca72d4de43 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:41.220419 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01f80d-685e-4b0b-b767-75a539d604dd None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:41.253515 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:41.254688 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bbfe1-43a7-4aa0-b022-1e8ddbef15ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:41.255470 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bbfe1-43a7-4aa0-b022-1e8ddbef15ff None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:41.255777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bbfe1-43a7-4aa0-b022-1e8ddbef15ff None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:41.256036 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bbfe1-43a7-4aa0-b022-1e8ddbef15ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:41.267013 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bbfe1-43a7-4aa0-b022-1e8ddbef15ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:41.268596 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bbfe1-43a7-4aa0-b022-1e8ddbef15ff None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:41.276919 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:41.287815 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-b45bbfe1-43a7-4aa0-b022-1e8ddbef15ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:41.287815 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:41.287815 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:41.287815 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:41.287815 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:41.287815 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:41.287815 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:41.287815 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:41.287815 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:41.287815 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:41.287815 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:41.287815 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:41.287815 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:41.287815 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:41.287815 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:41.288907 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:41.288907 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:41.288907 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:41.288907 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:41.288907 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:41.288907 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:41.288907 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:41.288907 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:41.288907 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:41.288907 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:41.288907 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:41.288907 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:41.288907 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:41.288907 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:41.288907 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:41.288907 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:41.288907 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:41.290095 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:41.290095 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:41.290095 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:41.290095 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:41.290095 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 278/560] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:41.290095 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bbfe1-43a7-4aa0-b022-1e8ddbef15ff None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:41.301190 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb59bd-5c39-415e-a504-40ca72d4de43 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:41.336422 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d186b-6c15-460e-88d8-e7e619363085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:41.337233 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d186b-6c15-460e-88d8-e7e619363085 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:41.337613 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d186b-6c15-460e-88d8-e7e619363085 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:41.337985 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d186b-6c15-460e-88d8-e7e619363085 None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:41.338844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d186b-6c15-460e-88d8-e7e619363085 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:41.339248 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d186b-6c15-460e-88d8-e7e619363085 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:41.340624 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d186b-6c15-460e-88d8-e7e619363085 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:41.352427 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 283/561] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:41.353367 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d186b-6c15-460e-88d8-e7e619363085 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:41.394194 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bbfe1-43a7-4aa0-b022-1e8ddbef15ff None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:41.429106 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8907d22-6522-4a52-949f-f1893592011e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:41.430232 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8907d22-6522-4a52-949f-f1893592011e None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:41.430540 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8907d22-6522-4a52-949f-f1893592011e None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:41.430806 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8907d22-6522-4a52-949f-f1893592011e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:41.442901 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8907d22-6522-4a52-949f-f1893592011e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:41.444383 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8907d22-6522-4a52-949f-f1893592011e None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:41.458703 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d186b-6c15-460e-88d8-e7e619363085 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:41.462323 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-c8907d22-6522-4a52-949f-f1893592011e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:41.462323 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:41.462323 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:41.462323 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:41.462323 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:41.462323 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:41.462323 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:41.462323 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:41.462323 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:41.462323 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:41.462323 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:41.462323 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:41.462323 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:41.462323 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:41.462323 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:41.463360 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:41.463360 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:41.463360 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:41.463360 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:41.463360 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:41.463360 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:41.463360 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:41.463360 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:41.463360 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:41.463360 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:41.463360 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:41.463360 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:41.463360 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:41.463360 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:41.463360 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:41.463360 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:41.463360 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:41.464331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:41.464331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:41.464331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:41.464331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:41.464331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 279/562] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:41.464622 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8907d22-6522-4a52-949f-f1893592011e None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:41.480097 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:41.497765 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d8647-0d4c-444b-bdc7-afc19c2a5e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:41.498462 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d8647-0d4c-444b-bdc7-afc19c2a5e5a None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:41.498742 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d8647-0d4c-444b-bdc7-afc19c2a5e5a None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:41.499014 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d8647-0d4c-444b-bdc7-afc19c2a5e5a None admin] PATH_INFO: `/v3/projects` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:41.499793 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d8647-0d4c-444b-bdc7-afc19c2a5e5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:41.500096 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d8647-0d4c-444b-bdc7-afc19c2a5e5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:41.501652 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d8647-0d4c-444b-bdc7-afc19c2a5e5a None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:41.513287 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 284/563] 10.222.0.39 () {56 vars in 1148 bytes} [Wed May 25 15:03:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:41.514028 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d8647-0d4c-444b-bdc7-afc19c2a5e5a None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:41.523571 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:41.572296 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8907d22-6522-4a52-949f-f1893592011e None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:41.609404 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c42a83-336e-4474-b1f0-3fda9ccc7b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:41.610455 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c42a83-336e-4474-b1f0-3fda9ccc7b39 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:41.610741 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c42a83-336e-4474-b1f0-3fda9ccc7b39 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:41.611015 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c42a83-336e-4474-b1f0-3fda9ccc7b39 None admin] PATH_INFO: `/v3/domains` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:41.611738 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c42a83-336e-4474-b1f0-3fda9ccc7b39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:41.612043 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c42a83-336e-4474-b1f0-3fda9ccc7b39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:41.613415 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c42a83-336e-4474-b1f0-3fda9ccc7b39 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:41.621010 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d8647-0d4c-444b-bdc7-afc19c2a5e5a None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:41.626108 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 280/564] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:41.627057 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c42a83-336e-4474-b1f0-3fda9ccc7b39 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:41.655818 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b60cb-84e3-4337-aefd-4a4577f0d505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:41.656623 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b60cb-84e3-4337-aefd-4a4577f0d505 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:41.656902 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b60cb-84e3-4337-aefd-4a4577f0d505 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:41.657216 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b60cb-84e3-4337-aefd-4a4577f0d505 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:41.664080 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b60cb-84e3-4337-aefd-4a4577f0d505 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:41.665530 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b60cb-84e3-4337-aefd-4a4577f0d505 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:41.679675 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-cd3b60cb-84e3-4337-aefd-4a4577f0d505 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:41.679675 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:41.679675 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:41.679675 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:41.679675 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:41.679675 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:41.679675 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:41.679675 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:41.679675 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:41.679675 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:41.679675 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:41.679675 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:41.679675 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:03:41.679675 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:03:41.679675 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:03:41.680751 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:03:41.680751 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:41.680751 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:41.680751 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:41.680751 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:41.680751 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:41.680751 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:41.680751 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:41.680751 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:41.680751 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:41.680751 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:41.680751 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:41.680751 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:41.680751 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:41.680751 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:41.680751 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:41.680751 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:41.682070 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:03:41.682070 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:03:41.682070 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:03:41.682070 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:03:41.682070 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:03:41.682070 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:03:41.682070 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:41.682070 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:41.682070 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 285/565] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:03:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:41.682701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b60cb-84e3-4337-aefd-4a4577f0d505 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:41.727785 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:41.737541 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c42a83-336e-4474-b1f0-3fda9ccc7b39 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:41.752531 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:41.774270 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922b8f1-c480-4860-b0e9-445caecabc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:41.774858 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922b8f1-c480-4860-b0e9-445caecabc8b None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:41.775144 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922b8f1-c480-4860-b0e9-445caecabc8b None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:41.775425 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922b8f1-c480-4860-b0e9-445caecabc8b None admin] PATH_INFO: `/v3/domains` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:41.776151 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922b8f1-c480-4860-b0e9-445caecabc8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:41.776463 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922b8f1-c480-4860-b0e9-445caecabc8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:41.777851 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922b8f1-c480-4860-b0e9-445caecabc8b None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:41.788991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b60cb-84e3-4337-aefd-4a4577f0d505 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:41.794058 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 281/566] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:41.794058 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922b8f1-c480-4860-b0e9-445caecabc8b None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:41.829121 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab415a-236b-4c8a-b2df-d5b4e489b9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:41.830083 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab415a-236b-4c8a-b2df-d5b4e489b9cd None admin] REQUEST_METHOD: `PUT` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:41.830332 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab415a-236b-4c8a-b2df-d5b4e489b9cd None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:41.830603 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab415a-236b-4c8a-b2df-d5b4e489b9cd None admin] PATH_INFO: `/v3/projects/ff4afc67ebcf4840946ce41755f94bf0/users/33f6a22c123f48a09af2f78636a04699/roles/eecb3a0cafcf49b5898e1ca834e110aa` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:41.846446 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab415a-236b-4c8a-b2df-d5b4e489b9cd None admin] RBAC: Authorizing `identity:create_grant(project_id=ff4afc67ebcf4840946ce41755f94bf0, user_id=33f6a22c123f48a09af2f78636a04699, role_id=eecb3a0cafcf49b5898e1ca834e110aa)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:41.847907 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab415a-236b-4c8a-b2df-d5b4e489b9cd None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:41.862968 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 286/567] 10.222.0.39 () {58 vars in 1439 bytes} [Wed May 25 15:03:41 2022] PUT /identity/v3/projects/ff4afc67ebcf4840946ce41755f94bf0/users/33f6a22c123f48a09af2f78636a04699/roles/eecb3a0cafcf49b5898e1ca834e110aa => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:41.863821 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab415a-236b-4c8a-b2df-d5b4e489b9cd None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:41.913365 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922b8f1-c480-4860-b0e9-445caecabc8b None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:41.952915 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeee255-27a5-4158-96a9-4e51dbf64b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:41.953890 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeee255-27a5-4158-96a9-4e51dbf64b5a None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:41.954191 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeee255-27a5-4158-96a9-4e51dbf64b5a None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:41.954924 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeee255-27a5-4158-96a9-4e51dbf64b5a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:41.963106 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeee255-27a5-4158-96a9-4e51dbf64b5a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:41.964615 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeee255-27a5-4158-96a9-4e51dbf64b5a None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:41.971512 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:41.980695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-2aeee255-27a5-4158-96a9-4e51dbf64b5a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 15:03:41.980695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:41.980695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:41.980695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:41.980695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:41.980695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:41.980695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:41.980695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:41.980695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:41.980695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:41.980695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:41.980695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:41.980695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:03:41.980695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:03:41.980695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:03:41.980695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:03:41.981749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:41.981749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:41.981749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:03:41.981749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:41.981749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:03:41.981749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:41.981749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:41.981749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:41.981749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:41.981749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:41.981749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:41.981749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:41.981749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:41.981749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:41.981749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:41.981749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:41.981749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:41.981749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:41.982713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:41.982713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:41.982713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:03:41.982713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:03:41.982713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:03:41.982713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:03:41.982713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:03:41.982713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:03:41.982713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 15:03:41.982713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:41.982713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 282/568] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:41.983319 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeee255-27a5-4158-96a9-4e51dbf64b5a None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:41.995017 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab415a-236b-4c8a-b2df-d5b4e489b9cd None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:42.019894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:42.039598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79253215-bbc0-46f3-a97b-9f01e6905701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:42.040785 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79253215-bbc0-46f3-a97b-9f01e6905701 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:42.041357 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79253215-bbc0-46f3-a97b-9f01e6905701 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:42.041644 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79253215-bbc0-46f3-a97b-9f01e6905701 None admin] PATH_INFO: `/v3/projects` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:42.042514 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79253215-bbc0-46f3-a97b-9f01e6905701 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:42.043031 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79253215-bbc0-46f3-a97b-9f01e6905701 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:42.044988 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79253215-bbc0-46f3-a97b-9f01e6905701 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:42.070832 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 287/569] 10.222.0.39 () {56 vars in 1148 bytes} [Wed May 25 15:03:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:42.072818 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79253215-bbc0-46f3-a97b-9f01e6905701 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:42.111194 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeee255-27a5-4158-96a9-4e51dbf64b5a None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:42.154216 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204abae7-6936-44cd-a449-ae7114265cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:42.155086 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204abae7-6936-44cd-a449-ae7114265cea None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:42.155424 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204abae7-6936-44cd-a449-ae7114265cea None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:42.155705 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204abae7-6936-44cd-a449-ae7114265cea None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:42.164699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204abae7-6936-44cd-a449-ae7114265cea None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:42.166171 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204abae7-6936-44cd-a449-ae7114265cea None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:42.182693 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-204abae7-6936-44cd-a449-ae7114265cea None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 15:03:42.182693 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:42.182693 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:42.182693 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:42.182693 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:42.182693 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:42.182693 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:42.182693 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:42.182693 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:42.182693 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:42.182693 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:42.182693 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:42.182693 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:03:42.182693 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:03:42.182693 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:03:42.182693 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:03:42.183722 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:42.183722 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:42.183722 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:03:42.183722 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:42.183722 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:03:42.183722 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:42.183722 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:42.183722 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:42.183722 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:42.183722 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:42.183722 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:42.183722 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:42.183722 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:42.183722 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:42.183722 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:42.183722 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:42.183722 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:42.183722 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:42.184646 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:42.184646 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:42.184646 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:03:42.184646 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:03:42.184646 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:03:42.184646 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:03:42.184646 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:03:42.184646 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:03:42.184646 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 15:03:42.184646 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:42.184646 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 283/570] 10.222.0.39 () {56 vars in 1102 bytes} [Wed May 25 15:03:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:42.185794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204abae7-6936-44cd-a449-ae7114265cea None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:42.208629 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79253215-bbc0-46f3-a97b-9f01e6905701 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:42.253072 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518dd8e-9020-4e1e-b0be-3187684910ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:42.253754 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518dd8e-9020-4e1e-b0be-3187684910ac None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:42.254035 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518dd8e-9020-4e1e-b0be-3187684910ac None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:42.254357 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518dd8e-9020-4e1e-b0be-3187684910ac None admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:42.255219 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518dd8e-9020-4e1e-b0be-3187684910ac None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:42.255525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518dd8e-9020-4e1e-b0be-3187684910ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:42.256976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518dd8e-9020-4e1e-b0be-3187684910ac None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:42.277143 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 288/571] 10.222.0.39 () {56 vars in 1137 bytes} [Wed May 25 15:03:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:42.278000 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518dd8e-9020-4e1e-b0be-3187684910ac None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:42.288747 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:42.324899 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:42.337409 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204abae7-6936-44cd-a449-ae7114265cea None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:42.377469 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7636a-732e-4c8f-8522-0aac78454e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:42.378426 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7636a-732e-4c8f-8522-0aac78454e0d None admin] REQUEST_METHOD: `PUT` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:42.378713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7636a-732e-4c8f-8522-0aac78454e0d None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:42.378984 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7636a-732e-4c8f-8522-0aac78454e0d None admin] PATH_INFO: `/v3/projects/ff4afc67ebcf4840946ce41755f94bf0/users/2b488bcd5ddc427fbdf78d56793a2035/roles/eecb3a0cafcf49b5898e1ca834e110aa` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:42.393213 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518dd8e-9020-4e1e-b0be-3187684910ac None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:42.397029 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7636a-732e-4c8f-8522-0aac78454e0d None admin] RBAC: Authorizing `identity:create_grant(project_id=ff4afc67ebcf4840946ce41755f94bf0, user_id=2b488bcd5ddc427fbdf78d56793a2035, role_id=eecb3a0cafcf49b5898e1ca834e110aa)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:42.398528 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7636a-732e-4c8f-8522-0aac78454e0d None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:42.426290 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 284/572] 10.222.0.39 () {58 vars in 1439 bytes} [Wed May 25 15:03:42 2022] PUT /identity/v3/projects/ff4afc67ebcf4840946ce41755f94bf0/users/2b488bcd5ddc427fbdf78d56793a2035/roles/eecb3a0cafcf49b5898e1ca834e110aa => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:42.426290 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7636a-732e-4c8f-8522-0aac78454e0d None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:42.451623 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc84c8e-0663-423b-81d6-14c58328d930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:42.452196 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc84c8e-0663-423b-81d6-14c58328d930 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:42.452548 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc84c8e-0663-423b-81d6-14c58328d930 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:42.452898 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc84c8e-0663-423b-81d6-14c58328d930 None admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:42.454166 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc84c8e-0663-423b-81d6-14c58328d930 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:42.454602 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc84c8e-0663-423b-81d6-14c58328d930 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:42.456213 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc84c8e-0663-423b-81d6-14c58328d930 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:42.487747 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 289/573] 10.222.0.39 () {56 vars in 1139 bytes} [Wed May 25 15:03:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:42.489982 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc84c8e-0663-423b-81d6-14c58328d930 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:42.585485 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:42.588265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7636a-732e-4c8f-8522-0aac78454e0d None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:42.629351 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0978b0-b8e5-4020-aa3c-c90f8797378a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:42.630172 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0978b0-b8e5-4020-aa3c-c90f8797378a None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:42.630482 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0978b0-b8e5-4020-aa3c-c90f8797378a None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:42.630753 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0978b0-b8e5-4020-aa3c-c90f8797378a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:42.646160 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0978b0-b8e5-4020-aa3c-c90f8797378a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:42.647664 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0978b0-b8e5-4020-aa3c-c90f8797378a None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:42.648497 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc84c8e-0663-423b-81d6-14c58328d930 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:42.649846 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:42.669233 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-be0978b0-b8e5-4020-aa3c-c90f8797378a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:42.669233 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:42.669233 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:42.669233 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:42.669233 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:42.669233 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:42.669233 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:42.669233 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:42.669233 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:42.669233 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:42.669233 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:42.669233 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:42.669233 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:42.669233 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:42.669233 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:42.670375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:42.670375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:42.670375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:42.670375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:42.670375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:42.670375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:42.670375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:42.670375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:42.670375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:42.670375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:42.670375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:42.670375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:42.670375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:42.670375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:42.670375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:42.670375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:42.670375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:42.671428 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:42.671428 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:42.671428 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:42.671428 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:42.671428 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 285/574] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:42.679890 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0978b0-b8e5-4020-aa3c-c90f8797378a None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:42.701659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902a903-ec52-4242-a842-5780ed231d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:42.703429 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902a903-ec52-4242-a842-5780ed231d67 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:42.703964 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902a903-ec52-4242-a842-5780ed231d67 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:42.704569 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902a903-ec52-4242-a842-5780ed231d67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:42.721520 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902a903-ec52-4242-a842-5780ed231d67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:42.722305 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902a903-ec52-4242-a842-5780ed231d67 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:42.748001 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-3902a903-ec52-4242-a842-5780ed231d67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:42.748001 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:42.748001 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:42.748001 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:42.748001 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:42.748001 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:42.748001 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:42.748001 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:42.748001 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:42.748001 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:42.748001 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:42.748001 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:42.748001 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:42.748001 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:42.748001 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:42.749138 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:42.749138 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:42.749138 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:42.749138 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:42.749138 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:42.749138 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:42.749138 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:42.749138 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:42.749138 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:42.749138 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:42.749138 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:42.749138 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:42.749138 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:42.749138 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:42.749138 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:42.749138 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:42.749138 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:42.750231 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:42.750231 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:42.750231 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:42.750231 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:42.752635 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 290/575] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:42.758986 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902a903-ec52-4242-a842-5780ed231d67 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:42.822460 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0978b0-b8e5-4020-aa3c-c90f8797378a None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:42.869843 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20e18d-64eb-4dc1-9343-e98fe6b391b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:42.870594 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20e18d-64eb-4dc1-9343-e98fe6b391b6 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:42.871081 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20e18d-64eb-4dc1-9343-e98fe6b391b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:42.871447 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20e18d-64eb-4dc1-9343-e98fe6b391b6 None admin] PATH_INFO: `/v3/domains` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:42.872200 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20e18d-64eb-4dc1-9343-e98fe6b391b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:42.872600 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20e18d-64eb-4dc1-9343-e98fe6b391b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:42.874173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20e18d-64eb-4dc1-9343-e98fe6b391b6 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:42.892174 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 286/576] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:42.893315 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20e18d-64eb-4dc1-9343-e98fe6b391b6 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:42.893652 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902a903-ec52-4242-a842-5780ed231d67 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:42.922717 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:42.943932 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18e3a5-99f6-4385-a042-314a1f0427d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:42.945692 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18e3a5-99f6-4385-a042-314a1f0427d9 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:42.946614 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18e3a5-99f6-4385-a042-314a1f0427d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:42.947046 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18e3a5-99f6-4385-a042-314a1f0427d9 None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:42.948329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18e3a5-99f6-4385-a042-314a1f0427d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:42.948792 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18e3a5-99f6-4385-a042-314a1f0427d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:42.951201 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab18e3a5-99f6-4385-a042-314a1f0427d9 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:42.961184 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:42.974103 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 291/577] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:42.975241 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18e3a5-99f6-4385-a042-314a1f0427d9 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:43.039014 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20e18d-64eb-4dc1-9343-e98fe6b391b6 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:43.089023 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9de70-76a8-4c12-9b98-784aad78b02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:43.090509 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9de70-76a8-4c12-9b98-784aad78b02b None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:43.090994 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9de70-76a8-4c12-9b98-784aad78b02b None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:43.091483 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9de70-76a8-4c12-9b98-784aad78b02b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:43.091689 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18e3a5-99f6-4385-a042-314a1f0427d9 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:43.100938 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9de70-76a8-4c12-9b98-784aad78b02b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:43.105113 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9de70-76a8-4c12-9b98-784aad78b02b None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:43.131794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-c2c9de70-76a8-4c12-9b98-784aad78b02b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:43.131794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:43.131794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:43.131794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:43.131794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:43.131794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:43.131794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:43.131794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:43.131794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:43.131794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:43.131794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:43.131794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:43.131794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:03:43.131794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:03:43.131794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:03:43.132725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:03:43.132725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:43.132725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:43.132725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:43.132725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:43.132725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:43.132725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:43.132725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:43.132725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:43.132725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:43.132725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:43.132725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:43.132725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:43.132725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:43.132725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:43.132725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:43.132725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:43.133600 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:03:43.133600 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:03:43.133600 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:03:43.133600 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:03:43.133600 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:03:43.133600 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:03:43.133600 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:43.133600 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:43.133600 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 287/578] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:03:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:43.142312 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9de70-76a8-4c12-9b98-784aad78b02b None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:43.149175 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c9391-be56-4b5f-8776-f4a631677c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:43.150475 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c9391-be56-4b5f-8776-f4a631677c5a None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:43.150970 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c9391-be56-4b5f-8776-f4a631677c5a None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:43.151458 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c9391-be56-4b5f-8776-f4a631677c5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:43.163627 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c9391-be56-4b5f-8776-f4a631677c5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:43.166113 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c9391-be56-4b5f-8776-f4a631677c5a None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:43.190776 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-7f1c9391-be56-4b5f-8776-f4a631677c5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:43.190776 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:43.190776 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:43.190776 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:43.190776 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:43.190776 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:43.190776 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:43.190776 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:43.190776 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:43.190776 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:43.190776 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:43.190776 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:43.190776 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:03:43.190776 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:03:43.190776 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:03:43.191962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:03:43.191962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:43.191962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:43.191962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:43.191962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:43.191962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:43.191962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:43.191962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:43.191962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:43.191962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:43.191962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:43.191962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:43.191962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:43.191962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:43.191962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:43.191962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:43.191962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:43.193041 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:03:43.193041 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:03:43.193041 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:03:43.193041 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:03:43.193041 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:03:43.193041 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:03:43.193041 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:43.193041 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:43.196526 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 292/579] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:03:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:03:43.202410 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c9391-be56-4b5f-8776-f4a631677c5a None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:43.243826 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:43.261054 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9de70-76a8-4c12-9b98-784aad78b02b None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:43.277525 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:43.300851 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe2af4-3381-4aad-bf38-5673d2237b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:43.301687 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe2af4-3381-4aad-bf38-5673d2237b2a None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:43.302078 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe2af4-3381-4aad-bf38-5673d2237b2a None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:43.302483 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe2af4-3381-4aad-bf38-5673d2237b2a None admin] PATH_INFO: `/v3/projects` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:43.303501 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe2af4-3381-4aad-bf38-5673d2237b2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:43.303906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe2af4-3381-4aad-bf38-5673d2237b2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:43.305456 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe2af4-3381-4aad-bf38-5673d2237b2a None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:43.322615 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 288/580] 10.222.0.39 () {56 vars in 1148 bytes} [Wed May 25 15:03:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:43.324245 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe2af4-3381-4aad-bf38-5673d2237b2a None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:43.331150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c9391-be56-4b5f-8776-f4a631677c5a None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:43.386702 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ddf0a-a915-47c7-84a3-ebe89920352c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:43.388600 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ddf0a-a915-47c7-84a3-ebe89920352c None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:43.389146 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ddf0a-a915-47c7-84a3-ebe89920352c None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:43.389679 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ddf0a-a915-47c7-84a3-ebe89920352c None admin] PATH_INFO: `/v3/projects` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:43.391073 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ddf0a-a915-47c7-84a3-ebe89920352c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:43.393131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ddf0a-a915-47c7-84a3-ebe89920352c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:43.399951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ddf0a-a915-47c7-84a3-ebe89920352c None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:43.420499 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 293/581] 10.222.0.39 () {56 vars in 1148 bytes} [Wed May 25 15:03:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:43.426522 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ddf0a-a915-47c7-84a3-ebe89920352c None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:43.452157 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe2af4-3381-4aad-bf38-5673d2237b2a None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:43.500488 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ab501-66bf-4d2d-ab02-f87285918cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:43.502154 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ab501-66bf-4d2d-ab02-f87285918cad None admin] REQUEST_METHOD: `PUT` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:43.502881 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ab501-66bf-4d2d-ab02-f87285918cad None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:43.504476 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ab501-66bf-4d2d-ab02-f87285918cad None admin] PATH_INFO: `/v3/projects/ff4afc67ebcf4840946ce41755f94bf0/users/57fc08f3464a47faac6390af7bd8a680/roles/eecb3a0cafcf49b5898e1ca834e110aa` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:43.524946 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ab501-66bf-4d2d-ab02-f87285918cad None admin] RBAC: Authorizing `identity:create_grant(project_id=ff4afc67ebcf4840946ce41755f94bf0, user_id=57fc08f3464a47faac6390af7bd8a680, role_id=eecb3a0cafcf49b5898e1ca834e110aa)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:43.526946 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ab501-66bf-4d2d-ab02-f87285918cad None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:43.553367 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 289/582] 10.222.0.39 () {58 vars in 1439 bytes} [Wed May 25 15:03:43 2022] PUT /identity/v3/projects/ff4afc67ebcf4840946ce41755f94bf0/users/57fc08f3464a47faac6390af7bd8a680/roles/eecb3a0cafcf49b5898e1ca834e110aa => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:43.593294 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:43.604416 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ddf0a-a915-47c7-84a3-ebe89920352c None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:43.648008 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0389f0-1033-4c83-a961-ab10fed6924a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:43.649237 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0389f0-1033-4c83-a961-ab10fed6924a None admin] REQUEST_METHOD: `PUT` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:43.649706 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0389f0-1033-4c83-a961-ab10fed6924a None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:43.650122 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0389f0-1033-4c83-a961-ab10fed6924a None admin] PATH_INFO: `/v3/projects/ff4afc67ebcf4840946ce41755f94bf0/users/f22ed37eb4a04bd4ad58739434623a48/roles/eecb3a0cafcf49b5898e1ca834e110aa` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:43.668575 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0389f0-1033-4c83-a961-ab10fed6924a None admin] RBAC: Authorizing `identity:create_grant(project_id=ff4afc67ebcf4840946ce41755f94bf0, user_id=f22ed37eb4a04bd4ad58739434623a48, role_id=eecb3a0cafcf49b5898e1ca834e110aa)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:43.670364 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0389f0-1033-4c83-a961-ab10fed6924a None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:43.689618 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 294/583] 10.222.0.39 () {58 vars in 1439 bytes} [Wed May 25 15:03:43 2022] PUT /identity/v3/projects/ff4afc67ebcf4840946ce41755f94bf0/users/f22ed37eb4a04bd4ad58739434623a48/roles/eecb3a0cafcf49b5898e1ca834e110aa => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:03:44.221959 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3566c77-bf19-4a30-bc8b-6f6cb5e9773f None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:44.222516 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3566c77-bf19-4a30-bc8b-6f6cb5e9773f None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:44.222671 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3566c77-bf19-4a30-bc8b-6f6cb5e9773f None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:44.224108 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 290/584] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:44.229715 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27012f2e-fd70-40f6-844c-7f6d8779175e None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:44.230170 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27012f2e-fd70-40f6-844c-7f6d8779175e None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:44.230376 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27012f2e-fd70-40f6-844c-7f6d8779175e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:44.247900 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-27012f2e-fd70-40f6-844c-7f6d8779175e None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:44.249136 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-27012f2e-fd70-40f6-844c-7f6d8779175e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:44.328762 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 295/585] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:44.354664 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3566c77-bf19-4a30-bc8b-6f6cb5e9773f None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:44.380433 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:44.475042 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3566c77-bf19-4a30-bc8b-6f6cb5e9773f None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:44.514812 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62c14b-d43b-4dc5-8c50-7ac901907aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:44.515646 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62c14b-d43b-4dc5-8c50-7ac901907aba None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:44.515927 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62c14b-d43b-4dc5-8c50-7ac901907aba None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:44.516333 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62c14b-d43b-4dc5-8c50-7ac901907aba None admin] PATH_INFO: `/v3/roles/service` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:44.530548 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62c14b-d43b-4dc5-8c50-7ac901907aba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:44.538791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-ac62c14b-d43b-4dc5-8c50-7ac901907aba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:44.538791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:44.538791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:44.538791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:44.538791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:44.538791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:44.538791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:44.538791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:44.538791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:44.538791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:44.538791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:44.538791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:44.538791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:44.538791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:44.538791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:44.538791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:44.539784 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:44.539784 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:44.539784 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:44.539784 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:44.539784 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:44.539784 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:44.539784 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:44.539784 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:44.539784 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:44.539784 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:44.539784 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:44.539784 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:44.539784 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:44.539784 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:44.539784 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:44.539784 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:44.540608 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:44.540608 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:44.540608 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:44.540608 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:44.540608 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:44.540608 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:44.540608 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:44.540608 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:44.540608 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:44.540608 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:44.540608 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:44.540608 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:44.540608 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 291/586] 10.222.0.39 () {56 vars in 1102 bytes} [Wed May 25 15:03:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:44.549963 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27012f2e-fd70-40f6-844c-7f6d8779175e None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:44.688633 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:44.716314 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27012f2e-fd70-40f6-844c-7f6d8779175e None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:44.762900 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0ac54-2592-4b94-9999-67fb558cc24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:44.763979 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0ac54-2592-4b94-9999-67fb558cc24a None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:44.764465 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0ac54-2592-4b94-9999-67fb558cc24a None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:44.764976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0ac54-2592-4b94-9999-67fb558cc24a None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:44.765964 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0ac54-2592-4b94-9999-67fb558cc24a None admin] RBAC: Adding query filter params (name=service) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:44.766650 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0ac54-2592-4b94-9999-67fb558cc24a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:44.768673 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0ac54-2592-4b94-9999-67fb558cc24a None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:44.779368 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 296/587] 10.222.0.39 () {56 vars in 1103 bytes} [Wed May 25 15:03:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:44.790231 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62c14b-d43b-4dc5-8c50-7ac901907aba None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:44.952995 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:44.975089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3da7f7-e62e-4323-9624-7ae4cbab60c4 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:44.975089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3da7f7-e62e-4323-9624-7ae4cbab60c4 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:44.975471 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3da7f7-e62e-4323-9624-7ae4cbab60c4 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:44.977997 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 297/588] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:03:44.982391 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3160fa-8c7c-4f07-b5ab-a73197120217 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:44.982677 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3160fa-8c7c-4f07-b5ab-a73197120217 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:44.982952 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3160fa-8c7c-4f07-b5ab-a73197120217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:44.986975 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62c14b-d43b-4dc5-8c50-7ac901907aba None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:45.001364 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-cf3160fa-8c7c-4f07-b5ab-a73197120217 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:45.002786 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-cf3160fa-8c7c-4f07-b5ab-a73197120217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:45.042918 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970879d-c2c8-4bb4-acb1-d2e680e8dae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:45.043717 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970879d-c2c8-4bb4-acb1-d2e680e8dae0 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:45.043934 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970879d-c2c8-4bb4-acb1-d2e680e8dae0 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:45.044207 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970879d-c2c8-4bb4-acb1-d2e680e8dae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:45.056065 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970879d-c2c8-4bb4-acb1-d2e680e8dae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:45.058056 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970879d-c2c8-4bb4-acb1-d2e680e8dae0 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:45.077590 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-e970879d-c2c8-4bb4-acb1-d2e680e8dae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:45.077590 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:45.077590 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:45.077590 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:45.077590 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:45.077590 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:45.077590 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:45.077590 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:45.077590 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:45.077590 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:45.077590 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:45.077590 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:45.077590 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:45.077590 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:45.077590 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:45.078649 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:45.078649 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:45.078649 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:45.078649 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:45.078649 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:45.078649 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:45.078649 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:45.078649 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:45.078649 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:45.078649 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:45.078649 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:45.078649 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:45.078649 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:45.078649 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:45.078649 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:45.078649 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:45.078649 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:45.079681 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:45.079681 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:45.079681 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:45.079681 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:45.079681 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 292/589] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:45.088100 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 298/590] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:45.088301 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970879d-c2c8-4bb4-acb1-d2e680e8dae0 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:45.117654 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3160fa-8c7c-4f07-b5ab-a73197120217 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:45.210114 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:45.255061 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3160fa-8c7c-4f07-b5ab-a73197120217 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:45.260695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970879d-c2c8-4bb4-acb1-d2e680e8dae0 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:45.297793 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d496e-dc17-4bd5-8d9f-3e18088592fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:45.299371 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d496e-dc17-4bd5-8d9f-3e18088592fd None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:45.299933 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d496e-dc17-4bd5-8d9f-3e18088592fd None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:45.300546 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d496e-dc17-4bd5-8d9f-3e18088592fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:45.301708 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679632a-6959-42a9-993e-b20b0d1f3d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:45.302512 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679632a-6959-42a9-993e-b20b0d1f3d67 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:45.302898 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679632a-6959-42a9-993e-b20b0d1f3d67 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:45.303248 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679632a-6959-42a9-993e-b20b0d1f3d67 None admin] PATH_INFO: `/v3/domains` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:45.304341 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679632a-6959-42a9-993e-b20b0d1f3d67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:45.304699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679632a-6959-42a9-993e-b20b0d1f3d67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:45.307014 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679632a-6959-42a9-993e-b20b0d1f3d67 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:45.315291 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d496e-dc17-4bd5-8d9f-3e18088592fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:45.319132 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:45.324016 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-c91d496e-dc17-4bd5-8d9f-3e18088592fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:45.324016 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:45.324016 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:45.324016 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:45.324016 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:45.324016 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:45.324016 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:45.324016 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:45.324016 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:45.324016 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:45.324016 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:45.324016 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:45.324016 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:45.324016 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:45.324016 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:45.324016 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:45.324994 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:45.324994 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:45.324994 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:45.324994 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:45.324994 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:45.324994 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:45.324994 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:45.324994 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:45.324994 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:45.324994 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:45.324994 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:45.324994 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:45.324994 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:45.324994 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:45.324994 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:45.324994 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:45.326397 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:45.326397 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:45.326397 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:45.326397 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:45.326397 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:45.326397 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:45.326397 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:45.326397 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:45.326397 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:45.326397 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:45.326397 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:45.326397 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:45.327038 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 293/591] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:45.329192 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 299/592] 10.222.0.39 () {56 vars in 1102 bytes} [Wed May 25 15:03:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:45.332030 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679632a-6959-42a9-993e-b20b0d1f3d67 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:45.341175 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d496e-dc17-4bd5-8d9f-3e18088592fd None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:45.455380 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679632a-6959-42a9-993e-b20b0d1f3d67 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:45.502860 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e6bf7-f6b8-48c3-b75a-efa985dc546a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:45.503707 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e6bf7-f6b8-48c3-b75a-efa985dc546a None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:45.503988 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e6bf7-f6b8-48c3-b75a-efa985dc546a None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:45.504263 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e6bf7-f6b8-48c3-b75a-efa985dc546a None admin] PATH_INFO: `/v3/users/nova` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:45.515667 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e6bf7-f6b8-48c3-b75a-efa985dc546a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:45.517386 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e6bf7-f6b8-48c3-b75a-efa985dc546a None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:45.537088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-3d8e6bf7-f6b8-48c3-b75a-efa985dc546a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 15:03:45.537088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:45.537088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:45.537088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:45.537088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:45.537088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:45.537088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:45.537088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:45.537088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:45.537088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:45.537088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:45.537088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:45.537088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:03:45.537088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:03:45.537088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:03:45.537088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:03:45.539088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:45.539088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:45.539088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:03:45.539088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:45.539088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:03:45.539088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:45.539088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:45.539088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:45.539088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:45.539088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:45.539088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:45.539088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:45.539088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:45.539088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:45.539088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:45.539088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:45.539088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:45.539088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:45.541190 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:45.541190 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:45.541190 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:03:45.541190 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:03:45.541190 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:03:45.541190 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:03:45.541190 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:03:45.541190 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:03:45.541190 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 15:03:45.541190 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:45.543303 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 294/593] 10.222.0.39 () {56 vars in 1093 bytes} [Wed May 25 15:03:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:03:45.544365 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e6bf7-f6b8-48c3-b75a-efa985dc546a None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:45.566098 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d496e-dc17-4bd5-8d9f-3e18088592fd None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:45.614000 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:45.623369 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:45.641526 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c328e4-e987-4891-b5d9-1660b8b39ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:45.643424 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c328e4-e987-4891-b5d9-1660b8b39ceb None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:45.644318 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c328e4-e987-4891-b5d9-1660b8b39ceb None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:45.645194 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c328e4-e987-4891-b5d9-1660b8b39ceb None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:45.647130 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c328e4-e987-4891-b5d9-1660b8b39ceb None admin] RBAC: Adding query filter params (name=service) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:45.648134 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c328e4-e987-4891-b5d9-1660b8b39ceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:45.651240 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c328e4-e987-4891-b5d9-1660b8b39ceb None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:45.664682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e6bf7-f6b8-48c3-b75a-efa985dc546a None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:45.674431 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 300/594] 10.222.0.39 () {56 vars in 1103 bytes} [Wed May 25 15:03:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:45.679501 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c328e4-e987-4891-b5d9-1660b8b39ceb None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:45.704944 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c587ec-bc29-4f43-983e-ae8c04504a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:45.705636 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c587ec-bc29-4f43-983e-ae8c04504a9b None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:45.705918 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c587ec-bc29-4f43-983e-ae8c04504a9b None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:45.706194 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c587ec-bc29-4f43-983e-ae8c04504a9b None admin] PATH_INFO: `/v3/users` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:45.707458 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c587ec-bc29-4f43-983e-ae8c04504a9b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:45.707774 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c587ec-bc29-4f43-983e-ae8c04504a9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:45.709569 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c587ec-bc29-4f43-983e-ae8c04504a9b None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:45.734359 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 295/595] 10.222.0.39 () {56 vars in 1133 bytes} [Wed May 25 15:03:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:45.740199 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c587ec-bc29-4f43-983e-ae8c04504a9b None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:45.886186 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c587ec-bc29-4f43-983e-ae8c04504a9b None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:45.903660 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:45.906561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c328e4-e987-4891-b5d9-1660b8b39ceb None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:45.928768 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563b294-0229-4262-b0e9-831b5360ae31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:45.929543 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563b294-0229-4262-b0e9-831b5360ae31 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:45.929874 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563b294-0229-4262-b0e9-831b5360ae31 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:45.930217 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563b294-0229-4262-b0e9-831b5360ae31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:45.979958 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c712334-e6db-4c51-b1ed-3bf7a5062ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:45.981962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c712334-e6db-4c51-b1ed-3bf7a5062ffa None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:45.982878 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c712334-e6db-4c51-b1ed-3bf7a5062ffa None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:45.983740 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c712334-e6db-4c51-b1ed-3bf7a5062ffa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:46.006148 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c712334-e6db-4c51-b1ed-3bf7a5062ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:46.009089 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563b294-0229-4262-b0e9-831b5360ae31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:46.010030 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c712334-e6db-4c51-b1ed-3bf7a5062ffa None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:46.010617 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563b294-0229-4262-b0e9-831b5360ae31 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:46.042833 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-7c712334-e6db-4c51-b1ed-3bf7a5062ffa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:46.042833 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:46.042833 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:46.042833 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:46.042833 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:46.042833 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:46.042833 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:46.042833 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:46.042833 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:46.042833 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:46.042833 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:46.042833 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:46.042833 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:46.042833 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:46.042833 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:46.044590 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:46.044590 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:46.044590 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:46.044590 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:46.044590 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:46.044590 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:46.044590 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:46.044590 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:46.044590 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:46.044590 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:46.044590 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:46.044590 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:46.044590 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:46.044590 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:46.044590 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:46.044590 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:46.044590 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:46.046317 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:46.046317 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:46.046317 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:46.046317 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:46.057341 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 301/596] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:46.060015 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c712334-e6db-4c51-b1ed-3bf7a5062ffa None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:46.131345 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 296/597] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:03:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:03:46.137357 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563b294-0229-4262-b0e9-831b5360ae31 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:46.152925 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:46.154907 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:46.259577 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563b294-0229-4262-b0e9-831b5360ae31 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:46.277353 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c712334-e6db-4c51-b1ed-3bf7a5062ffa None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:46.301134 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81599d33-e26f-467b-82ec-7966c823dba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:46.302022 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81599d33-e26f-467b-82ec-7966c823dba3 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:46.302438 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81599d33-e26f-467b-82ec-7966c823dba3 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:46.302775 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81599d33-e26f-467b-82ec-7966c823dba3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:46.317748 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81599d33-e26f-467b-82ec-7966c823dba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:46.319423 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81599d33-e26f-467b-82ec-7966c823dba3 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:46.332991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3572e52-36be-4bd9-b0e1-09e16ffc29eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:46.334083 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3572e52-36be-4bd9-b0e1-09e16ffc29eb None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:46.334696 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3572e52-36be-4bd9-b0e1-09e16ffc29eb None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:46.335161 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3572e52-36be-4bd9-b0e1-09e16ffc29eb None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:46.336151 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3572e52-36be-4bd9-b0e1-09e16ffc29eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:46.336770 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3572e52-36be-4bd9-b0e1-09e16ffc29eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:46.338405 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3572e52-36be-4bd9-b0e1-09e16ffc29eb None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:46.341212 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-81599d33-e26f-467b-82ec-7966c823dba3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:46.341212 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:46.341212 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:46.341212 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:46.341212 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:46.341212 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:46.341212 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:46.341212 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:46.341212 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:46.341212 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:46.341212 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:46.341212 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:46.341212 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:46.341212 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:46.341212 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:46.342105 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:46.342105 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:46.342105 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:46.342105 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:46.342105 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:46.342105 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:46.342105 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:46.342105 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:46.342105 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:46.342105 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:46.342105 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:46.342105 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:46.342105 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:46.342105 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:46.342105 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:46.342105 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:46.342105 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:46.343029 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:46.343029 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:46.343029 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:46.343029 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:46.347427 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 297/598] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:46.348634 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81599d33-e26f-467b-82ec-7966c823dba3 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:46.361101 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 302/599] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:46.362971 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3572e52-36be-4bd9-b0e1-09e16ffc29eb None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:46.423330 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:46.474591 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81599d33-e26f-467b-82ec-7966c823dba3 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:46.485662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3572e52-36be-4bd9-b0e1-09e16ffc29eb None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:46.488556 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:46.529019 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3106606-3fb7-480f-82e1-6d62c853f657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:46.529430 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3106606-3fb7-480f-82e1-6d62c853f657 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:46.529718 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3106606-3fb7-480f-82e1-6d62c853f657 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:46.529992 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3106606-3fb7-480f-82e1-6d62c853f657 None admin] PATH_INFO: `/v3/domains` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:46.530764 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3106606-3fb7-480f-82e1-6d62c853f657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:46.531083 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3106606-3fb7-480f-82e1-6d62c853f657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:46.532528 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3106606-3fb7-480f-82e1-6d62c853f657 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:46.535969 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e123d-c5be-4ba6-9682-c0fde9d4a5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:46.537050 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e123d-c5be-4ba6-9682-c0fde9d4a5fd None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:46.537458 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e123d-c5be-4ba6-9682-c0fde9d4a5fd None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:46.537861 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e123d-c5be-4ba6-9682-c0fde9d4a5fd None admin] PATH_INFO: `/v3/users/glance` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:46.546721 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 298/600] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:46.548262 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338026f3-7413-47c3-a2ee-53a6bc8b177c None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:46.548551 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338026f3-7413-47c3-a2ee-53a6bc8b177c None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:46.548826 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338026f3-7413-47c3-a2ee-53a6bc8b177c None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:46.554307 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 299/601] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:46.554307 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338026f3-7413-47c3-a2ee-53a6bc8b177c None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:46.557290 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e123d-c5be-4ba6-9682-c0fde9d4a5fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:46.558840 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e123d-c5be-4ba6-9682-c0fde9d4a5fd None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:46.575229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-6f6e123d-c5be-4ba6-9682-c0fde9d4a5fd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 15:03:46.575229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:46.575229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:46.575229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:46.575229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:46.575229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:46.575229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:46.575229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:46.575229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:46.575229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:46.575229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:46.575229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:46.575229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:03:46.575229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:03:46.575229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:03:46.575229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:03:46.582842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:46.582842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:46.582842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:03:46.582842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:46.582842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:03:46.582842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:46.582842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:46.582842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:46.582842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:46.582842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:46.582842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:46.582842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:46.582842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:46.582842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:46.582842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:46.582842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:46.582842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:46.582842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:46.584820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:46.584820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:46.584820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:03:46.584820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:03:46.584820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:03:46.584820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:03:46.584820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:03:46.584820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:03:46.584820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 15:03:46.584820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:46.584820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 303/602] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:46.584820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484270fb-ffa7-4882-bfb7-a8803195b1d5 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:46.584820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484270fb-ffa7-4882-bfb7-a8803195b1d5 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:46.586574 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484270fb-ffa7-4882-bfb7-a8803195b1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:46.595530 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-484270fb-ffa7-4882-bfb7-a8803195b1d5 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:46.596765 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-484270fb-ffa7-4882-bfb7-a8803195b1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:46.667231 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338026f3-7413-47c3-a2ee-53a6bc8b177c None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:46.695800 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:46.697450 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 304/603] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:46.699632 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04289615-9a04-4273-9f68-0a35d823601e None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:46.700117 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04289615-9a04-4273-9f68-0a35d823601e None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:46.700599 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04289615-9a04-4273-9f68-0a35d823601e None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:46.703465 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 305/604] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:46.704880 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04289615-9a04-4273-9f68-0a35d823601e None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:46.708951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81396ec7-f033-4851-90f3-dee2d45103ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:46.709771 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81396ec7-f033-4851-90f3-dee2d45103ff None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:46.710057 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81396ec7-f033-4851-90f3-dee2d45103ff None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:46.710363 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81396ec7-f033-4851-90f3-dee2d45103ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:46.720778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81396ec7-f033-4851-90f3-dee2d45103ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:46.722694 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81396ec7-f033-4851-90f3-dee2d45103ff None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:46.738902 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-81396ec7-f033-4851-90f3-dee2d45103ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:46.738902 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:46.738902 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:46.738902 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:46.738902 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:46.738902 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:46.738902 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:46.738902 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:46.738902 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:46.738902 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:46.738902 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:46.738902 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:46.738902 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:03:46.738902 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:03:46.738902 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:03:46.740020 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:03:46.740020 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:46.740020 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:46.740020 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:46.740020 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:46.740020 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:46.740020 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:46.740020 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:46.740020 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:46.740020 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:46.740020 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:46.740020 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:46.740020 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:46.740020 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:46.740020 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:46.740020 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:46.740020 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:46.741100 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:03:46.741100 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:03:46.741100 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:03:46.741100 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:03:46.741100 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:03:46.741100 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:03:46.741100 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:46.741100 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:46.741100 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 300/605] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:03:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:46.741682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d3d46-d988-431a-bcf8-029c1c3a1530 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:46.741682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d3d46-d988-431a-bcf8-029c1c3a1530 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:46.741948 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d3d46-d988-431a-bcf8-029c1c3a1530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:46.759583 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-245d3d46-d988-431a-bcf8-029c1c3a1530 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:46.760838 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-245d3d46-d988-431a-bcf8-029c1c3a1530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:46.817597 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:46.828868 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04289615-9a04-4273-9f68-0a35d823601e None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:46.837915 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 301/606] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:46.839346 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d3d46-d988-431a-bcf8-029c1c3a1530 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:46.876927 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff86b0e-1015-433f-a976-05af61217b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:46.877616 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff86b0e-1015-433f-a976-05af61217b5f None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:46.877913 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff86b0e-1015-433f-a976-05af61217b5f None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:46.878188 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff86b0e-1015-433f-a976-05af61217b5f None admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:46.879078 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff86b0e-1015-433f-a976-05af61217b5f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:46.879383 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff86b0e-1015-433f-a976-05af61217b5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:46.880891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff86b0e-1015-433f-a976-05af61217b5f None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:46.899643 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 306/607] 10.222.0.39 () {56 vars in 1137 bytes} [Wed May 25 15:03:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:46.900508 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff86b0e-1015-433f-a976-05af61217b5f None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:46.962601 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d3d46-d988-431a-bcf8-029c1c3a1530 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:46.987695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:47.010729 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9daad9-b6ad-4e78-9822-cbfcb92acf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:47.011777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9daad9-b6ad-4e78-9822-cbfcb92acf34 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:47.012154 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9daad9-b6ad-4e78-9822-cbfcb92acf34 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:47.012607 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9daad9-b6ad-4e78-9822-cbfcb92acf34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:47.023792 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff86b0e-1015-433f-a976-05af61217b5f None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:47.030672 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9daad9-b6ad-4e78-9822-cbfcb92acf34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:47.045515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-5b9daad9-b6ad-4e78-9822-cbfcb92acf34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:47.045515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:47.045515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:47.045515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:47.045515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:47.045515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:47.045515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:47.045515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:47.045515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:47.045515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:47.045515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:47.045515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:47.045515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:47.045515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:47.045515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:47.045515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:47.047147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:47.047147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:47.047147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:47.047147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:47.047147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:47.047147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:47.047147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:47.047147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:47.047147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:47.047147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:47.047147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:47.047147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:47.047147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:47.047147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:47.047147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:47.047147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:47.048542 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:47.048542 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:47.048542 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:47.048542 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:47.048542 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:47.048542 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:47.048542 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:47.048542 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:47.048542 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:47.048542 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:47.048542 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:47.048542 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:47.048542 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 302/608] 10.222.0.39 () {56 vars in 1102 bytes} [Wed May 25 15:03:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:47.049921 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9daad9-b6ad-4e78-9822-cbfcb92acf34 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:47.072043 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14b30c-d961-401a-b24c-58bce6cc73eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:47.072856 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14b30c-d961-401a-b24c-58bce6cc73eb None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:47.073263 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14b30c-d961-401a-b24c-58bce6cc73eb None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:47.073625 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14b30c-d961-401a-b24c-58bce6cc73eb None admin] PATH_INFO: `/v3/projects` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:47.074622 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14b30c-d961-401a-b24c-58bce6cc73eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:47.074996 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14b30c-d961-401a-b24c-58bce6cc73eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:47.076589 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14b30c-d961-401a-b24c-58bce6cc73eb None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:47.089739 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 307/609] 10.222.0.39 () {56 vars in 1148 bytes} [Wed May 25 15:03:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:47.091294 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14b30c-d961-401a-b24c-58bce6cc73eb None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:47.108859 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:47.190620 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9daad9-b6ad-4e78-9822-cbfcb92acf34 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:47.224354 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14b30c-d961-401a-b24c-58bce6cc73eb None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:47.236001 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8e592-6d4a-4754-9353-c9a7708c349f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:47.237347 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8e592-6d4a-4754-9353-c9a7708c349f None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:47.237797 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8e592-6d4a-4754-9353-c9a7708c349f None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:47.238271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf8e592-6d4a-4754-9353-c9a7708c349f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:47.255613 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf8e592-6d4a-4754-9353-c9a7708c349f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:47.270359 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-baf8e592-6d4a-4754-9353-c9a7708c349f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:47.270359 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:47.270359 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:47.270359 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:47.270359 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:47.270359 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:47.270359 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:47.270359 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:47.270359 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:47.270359 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:47.270359 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:47.270359 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:47.270359 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:47.270359 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:47.270359 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:47.270359 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:47.271512 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:47.271512 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:47.271512 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:47.271512 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:47.271512 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:47.271512 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:47.271512 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:47.271512 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:47.271512 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:47.271512 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:47.271512 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:47.271512 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:47.271512 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:47.271512 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:47.271512 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:47.271512 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:47.272617 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:47.272617 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:47.272617 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:47.272617 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:47.272617 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:47.272617 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:47.272617 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:47.272617 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:47.272617 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:47.272617 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:47.272617 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:03:47.272617 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:47.274265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 303/610] 10.222.0.39 () {56 vars in 1102 bytes} [Wed May 25 15:03:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:47.275401 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8e592-6d4a-4754-9353-c9a7708c349f None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:47.281520 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd237c-2eaf-4790-987d-813c228807c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:47.282626 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd237c-2eaf-4790-987d-813c228807c7 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:47.283073 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd237c-2eaf-4790-987d-813c228807c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:47.283523 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd237c-2eaf-4790-987d-813c228807c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:47.325977 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:47.377553 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd237c-2eaf-4790-987d-813c228807c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:47.379220 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd237c-2eaf-4790-987d-813c228807c7 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:47.394424 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:47.416762 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf8e592-6d4a-4754-9353-c9a7708c349f None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:47.472054 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0e695-1143-463a-b908-5148acdff627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:47.472888 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0e695-1143-463a-b908-5148acdff627 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:47.473239 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0e695-1143-463a-b908-5148acdff627 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:47.473674 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0e695-1143-463a-b908-5148acdff627 None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:47.475027 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0e695-1143-463a-b908-5148acdff627 None admin] RBAC: Adding query filter params (name=service) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:47.475384 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0e695-1143-463a-b908-5148acdff627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:47.477768 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0e695-1143-463a-b908-5148acdff627 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:47.491114 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 304/611] 10.222.0.39 () {56 vars in 1103 bytes} [Wed May 25 15:03:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:47.492103 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0e695-1143-463a-b908-5148acdff627 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:47.536311 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 308/612] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:03:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:03:47.537728 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd237c-2eaf-4790-987d-813c228807c7 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:47.672235 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:47.678376 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0e695-1143-463a-b908-5148acdff627 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:47.713487 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd237c-2eaf-4790-987d-813c228807c7 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:47.733411 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:47.737062 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfc886-afdd-43ee-a450-c4c30e984c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:47.738114 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfc886-afdd-43ee-a450-c4c30e984c27 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:47.738551 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfc886-afdd-43ee-a450-c4c30e984c27 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:47.739000 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfc886-afdd-43ee-a450-c4c30e984c27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:47.740387 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfc886-afdd-43ee-a450-c4c30e984c27 None admin] RBAC: Adding query filter params (role.id=eecb3a0cafcf49b5898e1ca834e110aa, scope.project.id=ff4afc67ebcf4840946ce41755f94bf0, user.id=33f6a22c123f48a09af2f78636a04699) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:47.740900 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfc886-afdd-43ee-a450-c4c30e984c27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:47.743546 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfc886-afdd-43ee-a450-c4c30e984c27 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:47.756808 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 305/613] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:03:47 2022] GET /identity/v3/role_assignments?user.id=33f6a22c123f48a09af2f78636a04699&scope.project.id=ff4afc67ebcf4840946ce41755f94bf0&role.id=eecb3a0cafcf49b5898e1ca834e110aa => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:47.758290 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfc886-afdd-43ee-a450-c4c30e984c27 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:47.772116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0716805-d5de-43ea-bd67-397f4ef3fdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:47.773058 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0716805-d5de-43ea-bd67-397f4ef3fdca None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:47.773563 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0716805-d5de-43ea-bd67-397f4ef3fdca None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:47.774118 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0716805-d5de-43ea-bd67-397f4ef3fdca None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:47.775241 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0716805-d5de-43ea-bd67-397f4ef3fdca None admin] RBAC: Adding query filter params (name=service) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:47.775724 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0716805-d5de-43ea-bd67-397f4ef3fdca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:47.777351 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0716805-d5de-43ea-bd67-397f4ef3fdca None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:47.791882 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 309/614] 10.222.0.39 () {56 vars in 1103 bytes} [Wed May 25 15:03:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:47.793217 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0716805-d5de-43ea-bd67-397f4ef3fdca None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:47.935882 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfc886-afdd-43ee-a450-c4c30e984c27 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:47.985818 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0716805-d5de-43ea-bd67-397f4ef3fdca None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:48.002500 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70773c15-bdcc-4a43-a05a-78a350ee8576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:48.004666 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70773c15-bdcc-4a43-a05a-78a350ee8576 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:48.005139 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70773c15-bdcc-4a43-a05a-78a350ee8576 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:48.005581 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70773c15-bdcc-4a43-a05a-78a350ee8576 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:48.028494 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70773c15-bdcc-4a43-a05a-78a350ee8576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:48.031294 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70773c15-bdcc-4a43-a05a-78a350ee8576 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:48.060796 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff03c0-0db1-4ec1-81d6-b70f448e324d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:48.061853 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff03c0-0db1-4ec1-81d6-b70f448e324d None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:48.062687 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff03c0-0db1-4ec1-81d6-b70f448e324d None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:48.062978 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff03c0-0db1-4ec1-81d6-b70f448e324d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:48.067412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-70773c15-bdcc-4a43-a05a-78a350ee8576 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:48.067412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:48.067412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:48.067412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:48.067412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:48.067412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:48.067412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:48.067412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:48.067412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:48.067412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:48.067412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:48.067412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:48.067412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:48.067412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:48.067412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:48.069633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:48.069633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:48.069633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:48.069633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:48.069633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:48.069633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:48.069633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:48.069633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:48.069633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:48.069633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:48.069633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:48.069633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:48.069633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:48.069633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:48.069633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:48.069633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:48.069633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:48.071259 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:48.071259 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:48.071259 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:48.071259 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:48.071259 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 306/615] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:48.076000 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70773c15-bdcc-4a43-a05a-78a350ee8576 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:48.086011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff03c0-0db1-4ec1-81d6-b70f448e324d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:48.089703 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff03c0-0db1-4ec1-81d6-b70f448e324d None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:48.108508 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:48.123420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-a9ff03c0-0db1-4ec1-81d6-b70f448e324d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:48.123420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:48.123420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:48.123420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:48.123420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:48.123420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:48.123420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:48.123420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:48.123420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:48.123420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:48.123420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:48.123420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:48.123420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:48.123420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:48.123420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:48.125045 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:48.125045 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:48.125045 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:48.125045 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:48.125045 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:48.125045 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:48.125045 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:48.125045 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:48.125045 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:48.125045 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:48.125045 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:48.125045 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:48.125045 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:48.125045 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:48.125045 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:48.125045 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:48.125045 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:48.126884 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:48.126884 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:48.126884 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:48.126884 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:48.126884 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 310/616] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:48.127996 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff03c0-0db1-4ec1-81d6-b70f448e324d None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:48.195547 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:48.313376 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff03c0-0db1-4ec1-81d6-b70f448e324d None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:48.314622 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70773c15-bdcc-4a43-a05a-78a350ee8576 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:48.359290 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bb4bf-91bf-46dc-82f7-433ea1ac3297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:48.360026 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bb4bf-91bf-46dc-82f7-433ea1ac3297 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:48.360306 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bb4bf-91bf-46dc-82f7-433ea1ac3297 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:48.360590 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bb4bf-91bf-46dc-82f7-433ea1ac3297 None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:48.361405 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bb4bf-91bf-46dc-82f7-433ea1ac3297 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:48.361763 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bb4bf-91bf-46dc-82f7-433ea1ac3297 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:48.363277 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769bb4bf-91bf-46dc-82f7-433ea1ac3297 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:48.382912 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 311/617] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:48.383909 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bb4bf-91bf-46dc-82f7-433ea1ac3297 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:48.406330 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8fce6-c617-4b58-a51a-358d0442ec61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:48.407253 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8fce6-c617-4b58-a51a-358d0442ec61 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:48.407533 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8fce6-c617-4b58-a51a-358d0442ec61 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:48.407805 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8fce6-c617-4b58-a51a-358d0442ec61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:48.428698 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8fce6-c617-4b58-a51a-358d0442ec61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:48.430173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8fce6-c617-4b58-a51a-358d0442ec61 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:48.449853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-45a8fce6-c617-4b58-a51a-358d0442ec61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:48.449853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:48.449853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:48.449853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:48.449853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:48.449853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:48.449853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:48.449853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:48.449853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:48.449853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:48.449853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:48.449853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:48.449853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:48.449853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:48.449853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:48.451422 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:48.451422 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:48.451422 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:48.451422 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:48.451422 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:48.451422 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:48.451422 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:48.451422 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:48.451422 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:48.451422 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:48.451422 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:48.451422 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:48.451422 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:48.451422 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:48.451422 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:48.451422 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:48.451422 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:48.453109 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:48.453109 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:48.453109 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:48.453109 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:48.456179 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 307/618] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:48.457182 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8fce6-c617-4b58-a51a-358d0442ec61 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:48.540627 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:48.577048 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:48.577777 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769bb4bf-91bf-46dc-82f7-433ea1ac3297 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:48.615675 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8fce6-c617-4b58-a51a-358d0442ec61 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:48.636942 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd23efc-116e-436c-8af3-8fcf38af77dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:48.637979 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd23efc-116e-436c-8af3-8fcf38af77dd None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:48.638498 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd23efc-116e-436c-8af3-8fcf38af77dd None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:48.638978 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd23efc-116e-436c-8af3-8fcf38af77dd None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:48.640341 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd23efc-116e-436c-8af3-8fcf38af77dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:48.640885 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd23efc-116e-436c-8af3-8fcf38af77dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:48.643523 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd23efc-116e-436c-8af3-8fcf38af77dd None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:48.657287 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0bfea-71ef-433a-a16d-865eab846b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:48.658113 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0bfea-71ef-433a-a16d-865eab846b04 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:48.658453 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0bfea-71ef-433a-a16d-865eab846b04 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:48.658700 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0bfea-71ef-433a-a16d-865eab846b04 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:48.668468 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 312/619] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:48.668468 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd23efc-116e-436c-8af3-8fcf38af77dd None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:48.669235 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0bfea-71ef-433a-a16d-865eab846b04 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:48.670821 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece0bfea-71ef-433a-a16d-865eab846b04 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:48.687231 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-ece0bfea-71ef-433a-a16d-865eab846b04 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 15:03:48.687231 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:48.687231 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:48.687231 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:48.687231 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:48.687231 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:48.687231 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:48.687231 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:48.687231 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:48.687231 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:48.687231 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:48.687231 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:48.687231 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:03:48.687231 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:03:48.687231 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:03:48.687231 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:03:48.688461 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:48.688461 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:48.688461 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:03:48.688461 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:48.688461 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:03:48.688461 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:48.688461 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:48.688461 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:48.688461 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:48.688461 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:48.688461 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:48.688461 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:48.688461 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:48.688461 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:48.688461 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:48.688461 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:48.688461 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:48.688461 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:48.689648 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:48.689648 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:48.689648 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:03:48.689648 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:03:48.689648 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:03:48.689648 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:03:48.689648 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:03:48.689648 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:03:48.689648 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 15:03:48.689648 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:48.694026 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 308/620] 10.222.0.39 () {56 vars in 1102 bytes} [Wed May 25 15:03:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:48.694989 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0bfea-71ef-433a-a16d-865eab846b04 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:48.821011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd23efc-116e-436c-8af3-8fcf38af77dd None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:48.840341 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0bfea-71ef-433a-a16d-865eab846b04 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:48.880102 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d2d50-a7e0-4755-9704-6ef49ad235d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:48.880951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d2d50-a7e0-4755-9704-6ef49ad235d4 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:48.881351 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d2d50-a7e0-4755-9704-6ef49ad235d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:48.881921 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d2d50-a7e0-4755-9704-6ef49ad235d4 None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:48.882854 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d2d50-a7e0-4755-9704-6ef49ad235d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:48.883505 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d2d50-a7e0-4755-9704-6ef49ad235d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:48.885080 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d2d50-a7e0-4755-9704-6ef49ad235d4 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:48.887561 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:48.902488 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b00802-0f0f-4d9f-bb56-78819bdedaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:48.903897 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b00802-0f0f-4d9f-bb56-78819bdedaf2 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:48.904387 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b00802-0f0f-4d9f-bb56-78819bdedaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:48.904868 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b00802-0f0f-4d9f-bb56-78819bdedaf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:48.906443 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 313/621] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:48.908111 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d2d50-a7e0-4755-9704-6ef49ad235d4 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:48.912887 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:48.918650 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b00802-0f0f-4d9f-bb56-78819bdedaf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:48.921218 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b00802-0f0f-4d9f-bb56-78819bdedaf2 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:48.958767 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-b8b00802-0f0f-4d9f-bb56-78819bdedaf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:48.958767 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:48.958767 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:48.958767 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:48.958767 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:48.958767 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:48.958767 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:48.958767 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:48.958767 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:48.958767 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:48.958767 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:48.958767 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:48.958767 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:03:48.958767 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:03:48.958767 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:03:48.960466 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:03:48.960466 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:48.960466 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:48.960466 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:48.960466 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:48.960466 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:48.960466 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:48.960466 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:48.960466 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:48.960466 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:48.960466 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:48.960466 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:48.960466 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:48.960466 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:48.960466 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:48.960466 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:48.960466 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:48.963415 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:03:48.963415 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:03:48.963415 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:03:48.963415 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:03:48.963415 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:03:48.963415 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:03:48.963415 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:48.963415 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:48.963415 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 309/622] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:03:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:48.963415 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b00802-0f0f-4d9f-bb56-78819bdedaf2 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:49.068159 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d2d50-a7e0-4755-9704-6ef49ad235d4 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:49.098337 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b00802-0f0f-4d9f-bb56-78819bdedaf2 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:49.127737 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8002ef4-ee2e-4f78-9893-7048103e7618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:49.128883 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8002ef4-ee2e-4f78-9893-7048103e7618 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:49.129335 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8002ef4-ee2e-4f78-9893-7048103e7618 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:49.129809 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8002ef4-ee2e-4f78-9893-7048103e7618 None admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:49.131474 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8002ef4-ee2e-4f78-9893-7048103e7618 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:49.131984 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8002ef4-ee2e-4f78-9893-7048103e7618 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:49.134596 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8002ef4-ee2e-4f78-9893-7048103e7618 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:49.158262 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e4195-0697-42cd-8d60-b8ea4f30ed63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:49.159649 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e4195-0697-42cd-8d60-b8ea4f30ed63 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:49.160095 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e4195-0697-42cd-8d60-b8ea4f30ed63 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:49.160557 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e4195-0697-42cd-8d60-b8ea4f30ed63 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:49.168993 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 314/623] 10.222.0.39 () {56 vars in 1139 bytes} [Wed May 25 15:03:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:49.177609 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8002ef4-ee2e-4f78-9893-7048103e7618 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:49.179954 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e4195-0697-42cd-8d60-b8ea4f30ed63 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:49.184129 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e4195-0697-42cd-8d60-b8ea4f30ed63 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:49.213384 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-5e9e4195-0697-42cd-8d60-b8ea4f30ed63 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 15:03:49.213384 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:49.213384 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:49.213384 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:49.213384 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:49.213384 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:49.213384 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:49.213384 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:49.213384 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:49.213384 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:49.213384 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:49.213384 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:49.213384 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:03:49.213384 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:03:49.213384 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:03:49.213384 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:03:49.223243 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:49.223243 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:49.223243 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:03:49.223243 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:49.223243 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:03:49.223243 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:49.223243 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:49.223243 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:49.223243 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:49.223243 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:49.223243 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:49.223243 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:49.223243 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:49.223243 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:49.223243 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:49.223243 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:49.223243 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:49.223243 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:49.225348 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:49.225348 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:49.225348 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:03:49.225348 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:03:49.225348 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:03:49.225348 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:03:49.225348 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:03:49.225348 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:03:49.225348 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 15:03:49.225348 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:49.225348 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 310/624] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:49.225348 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e4195-0697-42cd-8d60-b8ea4f30ed63 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:49.294223 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:49.308498 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:49.371041 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8002ef4-ee2e-4f78-9893-7048103e7618 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:49.386781 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e4195-0697-42cd-8d60-b8ea4f30ed63 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:49.438550 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf0010-e9ca-43a5-9741-5850d970f579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:49.439376 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ba54d-cd19-4598-b5c4-8bf06f08c754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:49.439715 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf0010-e9ca-43a5-9741-5850d970f579 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:49.439816 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ba54d-cd19-4598-b5c4-8bf06f08c754 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:49.440215 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf0010-e9ca-43a5-9741-5850d970f579 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:49.440309 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ba54d-cd19-4598-b5c4-8bf06f08c754 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:49.440694 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ba54d-cd19-4598-b5c4-8bf06f08c754 None admin] PATH_INFO: `/v3/projects` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:49.440815 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf0010-e9ca-43a5-9741-5850d970f579 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:49.442248 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ba54d-cd19-4598-b5c4-8bf06f08c754 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:49.442814 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ba54d-cd19-4598-b5c4-8bf06f08c754 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:49.445546 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ba54d-cd19-4598-b5c4-8bf06f08c754 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:49.472304 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 315/625] 10.222.0.39 () {56 vars in 1148 bytes} [Wed May 25 15:03:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:49.473486 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ba54d-cd19-4598-b5c4-8bf06f08c754 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:49.567677 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf0010-e9ca-43a5-9741-5850d970f579 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:49.570181 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf0010-e9ca-43a5-9741-5850d970f579 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:49.639297 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ba54d-cd19-4598-b5c4-8bf06f08c754 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:49.647153 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:49.684409 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:49.708317 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853dbbf-2f46-450e-a2b8-92b5a29542ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:49.709588 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853dbbf-2f46-450e-a2b8-92b5a29542ed None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:49.710144 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853dbbf-2f46-450e-a2b8-92b5a29542ed None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:49.710754 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853dbbf-2f46-450e-a2b8-92b5a29542ed None admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:49.712193 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853dbbf-2f46-450e-a2b8-92b5a29542ed None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:49.712695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853dbbf-2f46-450e-a2b8-92b5a29542ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:49.715117 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853dbbf-2f46-450e-a2b8-92b5a29542ed None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:49.757651 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 316/626] 10.222.0.39 () {56 vars in 1137 bytes} [Wed May 25 15:03:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:49.757848 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 311/627] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:03:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:03:49.757967 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853dbbf-2f46-450e-a2b8-92b5a29542ed None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:49.758045 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf0010-e9ca-43a5-9741-5850d970f579 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:49.900181 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853dbbf-2f46-450e-a2b8-92b5a29542ed None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:49.935025 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf0010-e9ca-43a5-9741-5850d970f579 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:49.961128 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b71ed-1a2e-481c-9a2c-34a1e04f1c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:49.962200 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b71ed-1a2e-481c-9a2c-34a1e04f1c91 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:49.962683 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b71ed-1a2e-481c-9a2c-34a1e04f1c91 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:49.963121 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b71ed-1a2e-481c-9a2c-34a1e04f1c91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:49.964530 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b71ed-1a2e-481c-9a2c-34a1e04f1c91 None admin] RBAC: Adding query filter params (role.id=eecb3a0cafcf49b5898e1ca834e110aa, scope.project.id=ff4afc67ebcf4840946ce41755f94bf0, user.id=2b488bcd5ddc427fbdf78d56793a2035) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:49.965030 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b71ed-1a2e-481c-9a2c-34a1e04f1c91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:49.967543 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b71ed-1a2e-481c-9a2c-34a1e04f1c91 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:49.979780 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 317/628] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:03:49 2022] GET /identity/v3/role_assignments?user.id=2b488bcd5ddc427fbdf78d56793a2035&scope.project.id=ff4afc67ebcf4840946ce41755f94bf0&role.id=eecb3a0cafcf49b5898e1ca834e110aa => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:49.981147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b71ed-1a2e-481c-9a2c-34a1e04f1c91 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:49.992002 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b0066-9698-47d0-8294-7a8019b92779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:49.993557 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b0066-9698-47d0-8294-7a8019b92779 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:49.994360 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b0066-9698-47d0-8294-7a8019b92779 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:49.995065 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b0066-9698-47d0-8294-7a8019b92779 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:50.024083 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:50.096173 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:50.134441 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b0066-9698-47d0-8294-7a8019b92779 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:50.137567 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b0066-9698-47d0-8294-7a8019b92779 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:50.218837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b71ed-1a2e-481c-9a2c-34a1e04f1c91 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:50.300396 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcd06e-1581-480d-8483-ec1311789c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:50.302689 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcd06e-1581-480d-8483-ec1311789c0a None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:50.303469 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcd06e-1581-480d-8483-ec1311789c0a None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:50.304202 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcd06e-1581-480d-8483-ec1311789c0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:50.324489 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dcd06e-1581-480d-8483-ec1311789c0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:50.329832 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dcd06e-1581-480d-8483-ec1311789c0a None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:50.354219 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 312/629] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:03:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:03:50.360435 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-83dcd06e-1581-480d-8483-ec1311789c0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:50.360435 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:50.360435 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:50.360435 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:50.360435 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:50.360435 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:50.360435 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:50.360435 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:50.360435 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:50.360435 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:50.360435 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:50.360435 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:50.360435 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:50.360435 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:50.360435 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:50.362182 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:50.362182 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:50.362182 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:50.362182 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:50.362182 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:50.362182 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:50.362182 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:50.362182 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:50.362182 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:50.362182 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:50.362182 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:50.362182 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:50.362182 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:50.362182 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:50.362182 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:50.362182 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:50.362182 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:50.364387 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:50.364387 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:50.364387 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:50.364387 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:50.364387 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 318/630] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:50.366995 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b0066-9698-47d0-8294-7a8019b92779 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:50.370853 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcd06e-1581-480d-8483-ec1311789c0a None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:50.482875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:50.560021 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:50.569521 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcd06e-1581-480d-8483-ec1311789c0a None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:50.588764 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b0066-9698-47d0-8294-7a8019b92779 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:50.613479 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944eb028-f54d-48d6-8d32-051825b00ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:50.614871 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944eb028-f54d-48d6-8d32-051825b00ea9 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:50.615306 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944eb028-f54d-48d6-8d32-051825b00ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:50.615708 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944eb028-f54d-48d6-8d32-051825b00ea9 None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:50.616730 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944eb028-f54d-48d6-8d32-051825b00ea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:50.617170 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944eb028-f54d-48d6-8d32-051825b00ea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:50.618868 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944eb028-f54d-48d6-8d32-051825b00ea9 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:50.634021 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 319/631] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:50.639889 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090dd4f-4a3c-40d1-b004-833baa05e889 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:50.640264 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090dd4f-4a3c-40d1-b004-833baa05e889 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:50.640501 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090dd4f-4a3c-40d1-b004-833baa05e889 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:50.646500 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 320/632] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:50.646500 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090dd4f-4a3c-40d1-b004-833baa05e889 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:50.661509 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89bafc-5bca-45be-94f6-5490afea9fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:50.662855 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89bafc-5bca-45be-94f6-5490afea9fed None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:50.663351 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89bafc-5bca-45be-94f6-5490afea9fed None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:50.663994 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89bafc-5bca-45be-94f6-5490afea9fed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:50.684113 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89bafc-5bca-45be-94f6-5490afea9fed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:50.686529 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89bafc-5bca-45be-94f6-5490afea9fed None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:50.721903 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-1b89bafc-5bca-45be-94f6-5490afea9fed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:50.721903 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:50.721903 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:50.721903 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:50.721903 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:50.721903 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:50.721903 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:50.721903 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:50.721903 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:50.721903 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:50.721903 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:50.721903 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:50.721903 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:50.721903 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:50.721903 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:50.723609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:50.723609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:50.723609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:50.723609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:50.723609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:50.723609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:50.723609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:50.723609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:50.723609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:50.723609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:50.723609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:50.723609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:50.723609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:50.723609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:50.723609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:50.723609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:50.723609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:50.733178 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:50.733178 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:50.733178 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:50.733178 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:50.733178 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 313/633] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:50.733178 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45239a88-0927-41a8-b165-879e0bebe789 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:50.733178 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45239a88-0927-41a8-b165-879e0bebe789 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:50.733178 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45239a88-0927-41a8-b165-879e0bebe789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:50.759503 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-45239a88-0927-41a8-b165-879e0bebe789 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:50.760742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-45239a88-0927-41a8-b165-879e0bebe789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:50.778133 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090dd4f-4a3c-40d1-b004-833baa05e889 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:50.823690 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a37f1-fddb-4acf-aeb7-6194a39f6812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:50.825003 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a37f1-fddb-4acf-aeb7-6194a39f6812 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:50.825469 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a37f1-fddb-4acf-aeb7-6194a39f6812 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:50.825929 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a37f1-fddb-4acf-aeb7-6194a39f6812 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:50.839596 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a37f1-fddb-4acf-aeb7-6194a39f6812 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:50.842551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a37f1-fddb-4acf-aeb7-6194a39f6812 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:50.860595 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 314/634] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:50.860995 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45239a88-0927-41a8-b165-879e0bebe789 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:50.873113 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-2b1a37f1-fddb-4acf-aeb7-6194a39f6812 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:50.873113 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:50.873113 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:50.873113 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:50.873113 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:50.873113 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:50.873113 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:50.873113 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:50.873113 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:50.873113 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:50.873113 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:50.873113 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:50.873113 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:03:50.873113 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:03:50.873113 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:03:50.875140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:03:50.875140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:50.875140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:50.875140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:50.875140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:50.875140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:50.875140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:50.875140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:50.875140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:50.875140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:50.875140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:50.875140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:50.875140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:50.875140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:50.875140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:50.875140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:50.875140 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:50.876813 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:03:50.876813 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:03:50.876813 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:03:50.876813 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:03:50.876813 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:03:50.876813 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:03:50.876813 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:50.876813 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:50.881011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 321/635] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:03:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:50.887515 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a37f1-fddb-4acf-aeb7-6194a39f6812 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:50.902862 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:50.927996 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:51.025471 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45239a88-0927-41a8-b165-879e0bebe789 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:51.052395 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a37f1-fddb-4acf-aeb7-6194a39f6812 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:51.081925 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8a136-6e02-41f6-9c11-f29cfaf6bbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:51.083159 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8a136-6e02-41f6-9c11-f29cfaf6bbe0 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:51.083669 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8a136-6e02-41f6-9c11-f29cfaf6bbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:51.084167 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8a136-6e02-41f6-9c11-f29cfaf6bbe0 None admin] PATH_INFO: `/v3/domains` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:51.085558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8a136-6e02-41f6-9c11-f29cfaf6bbe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:51.086288 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8a136-6e02-41f6-9c11-f29cfaf6bbe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:51.088998 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8a136-6e02-41f6-9c11-f29cfaf6bbe0 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:51.098566 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847f452-02c5-4ae6-a5fe-9b0e3fd6bf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:51.099341 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847f452-02c5-4ae6-a5fe-9b0e3fd6bf7f None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:51.099686 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847f452-02c5-4ae6-a5fe-9b0e3fd6bf7f None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:51.100025 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847f452-02c5-4ae6-a5fe-9b0e3fd6bf7f None admin] PATH_INFO: `/v3/projects` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:51.100882 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847f452-02c5-4ae6-a5fe-9b0e3fd6bf7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:51.101868 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847f452-02c5-4ae6-a5fe-9b0e3fd6bf7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:51.103390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847f452-02c5-4ae6-a5fe-9b0e3fd6bf7f None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:51.114781 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 315/636] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:51.114781 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8a136-6e02-41f6-9c11-f29cfaf6bbe0 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:51.130167 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 322/637] 10.222.0.39 () {56 vars in 1148 bytes} [Wed May 25 15:03:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:51.130167 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847f452-02c5-4ae6-a5fe-9b0e3fd6bf7f None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:51.239377 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:51.249364 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:51.269303 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8a136-6e02-41f6-9c11-f29cfaf6bbe0 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:51.272551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847f452-02c5-4ae6-a5fe-9b0e3fd6bf7f None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:51.310384 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4757eb5-c2c0-44cc-85cd-585f0f5dbc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:51.311110 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4757eb5-c2c0-44cc-85cd-585f0f5dbc6b None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:51.311387 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4757eb5-c2c0-44cc-85cd-585f0f5dbc6b None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:51.311668 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4757eb5-c2c0-44cc-85cd-585f0f5dbc6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:51.319445 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4757eb5-c2c0-44cc-85cd-585f0f5dbc6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:51.320920 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4757eb5-c2c0-44cc-85cd-585f0f5dbc6b None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:51.331263 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096098d-cd50-4447-9d45-b53270b164a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:51.332874 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096098d-cd50-4447-9d45-b53270b164a6 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:51.333544 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096098d-cd50-4447-9d45-b53270b164a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:51.334175 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096098d-cd50-4447-9d45-b53270b164a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:51.335972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-e4757eb5-c2c0-44cc-85cd-585f0f5dbc6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:51.335972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:51.335972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:51.335972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:51.335972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:51.335972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:51.335972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:51.335972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:51.335972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:51.335972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:51.335972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:51.335972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:51.335972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:03:51.335972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:03:51.335972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:03:51.337840 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:03:51.337840 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:51.337840 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:51.337840 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:51.337840 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:51.337840 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:51.337840 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:51.337840 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:51.337840 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:51.337840 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:51.337840 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:51.337840 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:51.337840 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:51.337840 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:51.337840 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:51.337840 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:51.337840 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:51.339543 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:03:51.339543 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:03:51.339543 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:03:51.339543 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:03:51.339543 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:03:51.339543 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:03:51.339543 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:51.339543 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:51.339543 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 323/638] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:03:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:51.339543 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4757eb5-c2c0-44cc-85cd-585f0f5dbc6b None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:51.354069 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096098d-cd50-4447-9d45-b53270b164a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:51.362476 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-6096098d-cd50-4447-9d45-b53270b164a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:03:51.362476 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:51.362476 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:51.362476 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:51.362476 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:51.362476 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:51.362476 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:51.362476 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:51.362476 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:51.362476 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:51.362476 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:51.362476 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:51.362476 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:51.362476 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:51.362476 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:51.362476 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:51.364810 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:51.364810 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:51.364810 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:51.364810 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:51.364810 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:51.364810 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:51.364810 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:51.364810 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:51.364810 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:51.364810 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:51.364810 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:51.364810 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:51.364810 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:51.364810 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:51.364810 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:51.364810 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:51.366822 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:51.366822 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:51.366822 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:51.366822 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:51.366822 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:51.366822 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:51.366822 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:51.366822 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:51.366822 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:51.366822 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:51.366822 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:03:51.366822 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:51.366822 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 316/639] 10.222.0.39 () {56 vars in 1096 bytes} [Wed May 25 15:03:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:51.369380 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096098d-cd50-4447-9d45-b53270b164a6 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:51.490896 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096098d-cd50-4447-9d45-b53270b164a6 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:51.531779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4757eb5-c2c0-44cc-85cd-585f0f5dbc6b None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:51.533566 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a164a-add7-4471-a377-b8af8d63e313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:51.534286 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a164a-add7-4471-a377-b8af8d63e313 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:51.534748 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a164a-add7-4471-a377-b8af8d63e313 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:51.535029 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a164a-add7-4471-a377-b8af8d63e313 None admin] PATH_INFO: `/v3/projects` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:51.536659 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a164a-add7-4471-a377-b8af8d63e313 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:51.537000 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a164a-add7-4471-a377-b8af8d63e313 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:51.538518 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a164a-add7-4471-a377-b8af8d63e313 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:51.553414 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 317/640] 10.222.0.39 () {56 vars in 1148 bytes} [Wed May 25 15:03:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:51.554299 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a164a-add7-4471-a377-b8af8d63e313 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:51.566813 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:51.590719 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc100eb-f4ea-4b7c-a9ba-7f838651331f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:51.591549 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc100eb-f4ea-4b7c-a9ba-7f838651331f None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:51.591728 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc100eb-f4ea-4b7c-a9ba-7f838651331f None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:51.591877 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc100eb-f4ea-4b7c-a9ba-7f838651331f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:51.592736 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc100eb-f4ea-4b7c-a9ba-7f838651331f None admin] RBAC: Adding query filter params (role.id=eecb3a0cafcf49b5898e1ca834e110aa, scope.project.id=ff4afc67ebcf4840946ce41755f94bf0, user.id=f22ed37eb4a04bd4ad58739434623a48) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:51.593048 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc100eb-f4ea-4b7c-a9ba-7f838651331f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:51.594731 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc100eb-f4ea-4b7c-a9ba-7f838651331f None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:51.598493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:51.622365 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 324/641] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:03:51 2022] GET /identity/v3/role_assignments?user.id=f22ed37eb4a04bd4ad58739434623a48&scope.project.id=ff4afc67ebcf4840946ce41755f94bf0&role.id=eecb3a0cafcf49b5898e1ca834e110aa => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:51.622365 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc100eb-f4ea-4b7c-a9ba-7f838651331f None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:51.727770 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a164a-add7-4471-a377-b8af8d63e313 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:51.792432 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a823b8-0235-4b2c-8a86-24defe59ec06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:51.793269 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a823b8-0235-4b2c-8a86-24defe59ec06 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:51.793559 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a823b8-0235-4b2c-8a86-24defe59ec06 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:51.793837 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a823b8-0235-4b2c-8a86-24defe59ec06 None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:51.795477 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a823b8-0235-4b2c-8a86-24defe59ec06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:51.795813 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a823b8-0235-4b2c-8a86-24defe59ec06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:51.798455 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a823b8-0235-4b2c-8a86-24defe59ec06 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:51.802430 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc100eb-f4ea-4b7c-a9ba-7f838651331f None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:51.812389 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 318/642] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:51.821225 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a823b8-0235-4b2c-8a86-24defe59ec06 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:51.851393 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c56c54-af15-4a67-b950-cc9dd389df82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:51.852426 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c56c54-af15-4a67-b950-cc9dd389df82 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:51.852780 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c56c54-af15-4a67-b950-cc9dd389df82 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:51.853226 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c56c54-af15-4a67-b950-cc9dd389df82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:51.854169 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c56c54-af15-4a67-b950-cc9dd389df82 None admin] RBAC: Adding query filter params (role.id=eecb3a0cafcf49b5898e1ca834e110aa, scope.project.id=ff4afc67ebcf4840946ce41755f94bf0, user.id=57fc08f3464a47faac6390af7bd8a680) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:51.854593 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c56c54-af15-4a67-b950-cc9dd389df82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:51.856175 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c56c54-af15-4a67-b950-cc9dd389df82 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:51.864588 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 325/643] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:03:51 2022] GET /identity/v3/role_assignments?user.id=57fc08f3464a47faac6390af7bd8a680&scope.project.id=ff4afc67ebcf4840946ce41755f94bf0&role.id=eecb3a0cafcf49b5898e1ca834e110aa => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:51.921783 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:51.977466 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a823b8-0235-4b2c-8a86-24defe59ec06 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:52.028667 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2d39f-e5a7-45ab-a31f-d5c44b3689e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:52.029538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2d39f-e5a7-45ab-a31f-d5c44b3689e3 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:52.029815 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2d39f-e5a7-45ab-a31f-d5c44b3689e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:52.030096 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2d39f-e5a7-45ab-a31f-d5c44b3689e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:52.045385 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2d39f-e5a7-45ab-a31f-d5c44b3689e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:52.047407 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2d39f-e5a7-45ab-a31f-d5c44b3689e3 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:52.080328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-7bf2d39f-e5a7-45ab-a31f-d5c44b3689e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:52.080328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:52.080328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:52.080328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:52.080328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:52.080328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:52.080328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:52.080328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:52.080328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:52.080328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:52.080328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:52.080328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:52.080328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:52.080328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:52.080328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:52.081293 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:52.081293 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:52.081293 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:52.081293 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:52.081293 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:52.081293 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:52.081293 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:52.081293 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:52.081293 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:52.081293 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:52.081293 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:52.081293 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:52.081293 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:52.081293 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:52.081293 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:52.081293 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:52.081293 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:52.082313 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:52.082313 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:52.082313 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:52.082313 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:52.084263 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 319/644] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:52.091095 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c56c54-af15-4a67-b950-cc9dd389df82 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:52.211620 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:52.259853 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c56c54-af15-4a67-b950-cc9dd389df82 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:52.301298 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5486a-89dd-4781-b609-b1802d5c347c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:52.302012 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5486a-89dd-4781-b609-b1802d5c347c None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:52.302329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5486a-89dd-4781-b609-b1802d5c347c None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:52.302610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5486a-89dd-4781-b609-b1802d5c347c None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:52.303383 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5486a-89dd-4781-b609-b1802d5c347c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:52.303692 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5486a-89dd-4781-b609-b1802d5c347c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:52.305200 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5486a-89dd-4781-b609-b1802d5c347c None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:52.320625 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 326/645] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:52.326230 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2d39f-e5a7-45ab-a31f-d5c44b3689e3 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:52.443227 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2d39f-e5a7-45ab-a31f-d5c44b3689e3 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:52.470641 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:52.483405 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03bb68-dadf-4893-90c0-af42fe8b904a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:52.484901 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03bb68-dadf-4893-90c0-af42fe8b904a None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:52.485547 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03bb68-dadf-4893-90c0-af42fe8b904a None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:52.486033 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03bb68-dadf-4893-90c0-af42fe8b904a None admin] PATH_INFO: `/v3/users/nova` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:52.496302 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03bb68-dadf-4893-90c0-af42fe8b904a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:52.498665 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd03bb68-dadf-4893-90c0-af42fe8b904a None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:52.516936 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-cd03bb68-dadf-4893-90c0-af42fe8b904a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 15:03:52.516936 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:52.516936 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:52.516936 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:52.516936 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:52.516936 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:52.516936 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:52.516936 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:52.516936 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:52.516936 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:52.516936 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:52.516936 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:52.516936 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:03:52.516936 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:03:52.516936 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:03:52.516936 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:03:52.518143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:52.518143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:52.518143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:03:52.518143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:52.518143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:03:52.518143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:52.518143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:52.518143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:52.518143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:52.518143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:52.518143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:52.518143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:52.518143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:52.518143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:52.518143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:52.518143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:52.518143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:52.518143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:52.519437 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:52.519437 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:52.519437 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:03:52.519437 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:03:52.519437 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:03:52.519437 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:03:52.519437 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:03:52.519437 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:03:52.519437 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 15:03:52.519437 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:52.522114 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 320/646] 10.222.0.39 () {56 vars in 1093 bytes} [Wed May 25 15:03:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:52.528124 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5486a-89dd-4781-b609-b1802d5c347c None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:52.645879 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5486a-89dd-4781-b609-b1802d5c347c None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:52.674118 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:52.686954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bb1b2-0c2e-493f-b04f-80857babe9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:52.687761 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bb1b2-0c2e-493f-b04f-80857babe9c3 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:52.688049 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bb1b2-0c2e-493f-b04f-80857babe9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:52.688322 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bb1b2-0c2e-493f-b04f-80857babe9c3 None admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:52.689192 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bb1b2-0c2e-493f-b04f-80857babe9c3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:52.689497 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bb1b2-0c2e-493f-b04f-80857babe9c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:52.691034 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bb1b2-0c2e-493f-b04f-80857babe9c3 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:52.711691 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 327/647] 10.222.0.39 () {56 vars in 1133 bytes} [Wed May 25 15:03:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:52.717121 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03bb68-dadf-4893-90c0-af42fe8b904a None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:52.832918 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd03bb68-dadf-4893-90c0-af42fe8b904a None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:52.870451 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849558f3-9214-4fa7-8760-96ec6e1aa441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:52.871119 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849558f3-9214-4fa7-8760-96ec6e1aa441 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:52.871400 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849558f3-9214-4fa7-8760-96ec6e1aa441 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:52.871669 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849558f3-9214-4fa7-8760-96ec6e1aa441 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:52.927575 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:52.935830 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f73172-efcb-4352-99a9-2bf24351e352 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:52.936930 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f73172-efcb-4352-99a9-2bf24351e352 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:52.937425 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f73172-efcb-4352-99a9-2bf24351e352 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:52.947857 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 328/648] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:52 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:52.949465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849558f3-9214-4fa7-8760-96ec6e1aa441 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:52.950406 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44230e2c-a488-40ab-a9cf-ce212a1cd5fe None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:52.950884 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44230e2c-a488-40ab-a9cf-ce212a1cd5fe None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:52.950990 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849558f3-9214-4fa7-8760-96ec6e1aa441 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:52.951343 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44230e2c-a488-40ab-a9cf-ce212a1cd5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:52.981880 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-44230e2c-a488-40ab-a9cf-ce212a1cd5fe None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:52.984307 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-44230e2c-a488-40ab-a9cf-ce212a1cd5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:53.067589 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 321/649] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:03:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:03:53.073605 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849558f3-9214-4fa7-8760-96ec6e1aa441 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:53.114682 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 329/650] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:53.149340 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44230e2c-a488-40ab-a9cf-ce212a1cd5fe None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:53.194702 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:53.202434 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849558f3-9214-4fa7-8760-96ec6e1aa441 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:53.268542 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fdc2c-23b3-41d7-81e1-b890b7fe7400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:53.270314 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fdc2c-23b3-41d7-81e1-b890b7fe7400 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:53.271366 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fdc2c-23b3-41d7-81e1-b890b7fe7400 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:53.271837 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fdc2c-23b3-41d7-81e1-b890b7fe7400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:53.294365 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fdc2c-23b3-41d7-81e1-b890b7fe7400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:53.297466 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fdc2c-23b3-41d7-81e1-b890b7fe7400 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:53.333912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-7a8fdc2c-23b3-41d7-81e1-b890b7fe7400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:53.333912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:53.333912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:53.333912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:53.333912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:53.333912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:53.333912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:53.333912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:53.333912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:53.333912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:53.333912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:53.333912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:53.333912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:53.333912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:53.333912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:53.335922 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:53.335922 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:53.335922 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:53.335922 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:53.335922 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:53.335922 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:53.335922 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:53.335922 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:53.335922 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:53.335922 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:53.335922 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:53.335922 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:53.335922 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:53.335922 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:53.335922 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:53.335922 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:53.335922 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:53.338724 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:53.338724 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:53.338724 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:53.338724 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:53.338724 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 322/651] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:03:53.344686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fdc2c-23b3-41d7-81e1-b890b7fe7400 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:53.374440 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44230e2c-a488-40ab-a9cf-ce212a1cd5fe None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:53.405268 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:53.444943 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cc13e-c9fc-41f5-9002-1487693654e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:53.446942 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cc13e-c9fc-41f5-9002-1487693654e5 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:53.447786 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cc13e-c9fc-41f5-9002-1487693654e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:53.448537 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cc13e-c9fc-41f5-9002-1487693654e5 None admin] PATH_INFO: `/v3/services/image` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:53.450283 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cc13e-c9fc-41f5-9002-1487693654e5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:53.453339 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cc13e-c9fc-41f5-9002-1487693654e5 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:53.471732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-b04cc13e-c9fc-41f5-9002-1487693654e5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:03:53.471732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:53.471732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:03:53.471732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:03:53.471732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:03:53.471732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:03:53.471732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:03:53.471732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:03:53.471732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:03:53.471732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:53.471732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:03:53.471732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:53.471732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:53.471732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:53.471732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:53.471732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:53.471732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:53.472789 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:53.472789 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:53.472789 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:53.472789 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:53.472789 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:53.472789 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:53.472789 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:03:53.472789 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:03:53.472789 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:03:53.472789 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:03:53.472789 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:53.472789 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:53.472789 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:53.472789 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:53.472789 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:53.472789 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:53.473630 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:53.473630 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:53.473630 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:53.473630 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:53.473630 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:53.473630 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:53.473630 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:53.473630 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:53.473630 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:53.473630 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:53.473630 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:03:53.473630 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:03:53.473630 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:03:53.473630 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:53.482750 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 330/652] 10.222.0.39 () {56 vars in 1105 bytes} [Wed May 25 15:03:53 2022] GET /identity/v3/services/image => generated 86 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:53.484701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cc13e-c9fc-41f5-9002-1487693654e5 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:53.578593 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fdc2c-23b3-41d7-81e1-b890b7fe7400 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:53.613357 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cc13e-c9fc-41f5-9002-1487693654e5 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:53.654490 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c972f-9913-4cb4-a23a-79c29a2f0620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:53.655642 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c972f-9913-4cb4-a23a-79c29a2f0620 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:53.656143 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c972f-9913-4cb4-a23a-79c29a2f0620 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:53.656693 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c972f-9913-4cb4-a23a-79c29a2f0620 None admin] PATH_INFO: `/v3/domains` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:53.658265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c972f-9913-4cb4-a23a-79c29a2f0620 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:53.658874 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c972f-9913-4cb4-a23a-79c29a2f0620 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:53.661586 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c972f-9913-4cb4-a23a-79c29a2f0620 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:53.664528 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:53.669379 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f62c40-adfd-4926-b515-dd78a4e96a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:53.671005 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f62c40-adfd-4926-b515-dd78a4e96a02 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:53.671575 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f62c40-adfd-4926-b515-dd78a4e96a02 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:53.672119 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f62c40-adfd-4926-b515-dd78a4e96a02 None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:53.674076 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f62c40-adfd-4926-b515-dd78a4e96a02 None admin] RBAC: Adding query filter params (name=image) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:53.674685 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f62c40-adfd-4926-b515-dd78a4e96a02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:53.676596 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f62c40-adfd-4926-b515-dd78a4e96a02 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:53.687636 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 331/653] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:53.689585 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f62c40-adfd-4926-b515-dd78a4e96a02 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:53.689820 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 323/654] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:53.700784 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c972f-9913-4cb4-a23a-79c29a2f0620 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:53.739717 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:53.852768 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f62c40-adfd-4926-b515-dd78a4e96a02 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:53.903220 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c972f-9913-4cb4-a23a-79c29a2f0620 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:53.916653 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a19864-6da4-4b15-b001-76eb792de641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:53.918051 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a19864-6da4-4b15-b001-76eb792de641 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:53.918735 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a19864-6da4-4b15-b001-76eb792de641 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:53.919365 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a19864-6da4-4b15-b001-76eb792de641 None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:53.920727 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a19864-6da4-4b15-b001-76eb792de641 None admin] RBAC: Adding query filter params (type=image) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:53.921417 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a19864-6da4-4b15-b001-76eb792de641 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:53.924247 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a19864-6da4-4b15-b001-76eb792de641 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:53.932430 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 332/655] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:53 2022] GET /identity/v3/services?type=image => generated 122 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:53.979609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef5c76-3014-4b7f-9364-56f2dda77ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:53.980726 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef5c76-3014-4b7f-9364-56f2dda77ec0 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:53.981166 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef5c76-3014-4b7f-9364-56f2dda77ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:53.981619 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef5c76-3014-4b7f-9364-56f2dda77ec0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:53.991326 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef5c76-3014-4b7f-9364-56f2dda77ec0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:53.993133 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef5c76-3014-4b7f-9364-56f2dda77ec0 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:54.013795 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-55ef5c76-3014-4b7f-9364-56f2dda77ec0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:54.013795 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:54.013795 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:54.013795 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:54.013795 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:54.013795 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:54.013795 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:54.013795 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:54.013795 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:54.013795 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:54.013795 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:54.013795 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:54.013795 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:03:54.013795 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:03:54.013795 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:03:54.014998 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:03:54.014998 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:54.014998 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:54.014998 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:54.014998 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:54.014998 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:54.014998 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:54.014998 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:54.014998 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:54.014998 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:54.014998 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:54.014998 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:54.014998 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:54.014998 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:54.014998 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:54.014998 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:54.014998 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:54.016146 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:03:54.016146 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:03:54.016146 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:03:54.016146 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:03:54.016146 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:03:54.016146 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:03:54.016146 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:54.016146 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:54.018493 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 324/656] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:03:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:54.027982 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a19864-6da4-4b15-b001-76eb792de641 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:54.228777 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a19864-6da4-4b15-b001-76eb792de641 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:54.232054 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:54.294816 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66d9ab-9084-4878-892b-f1f087f88c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:54.296483 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66d9ab-9084-4878-892b-f1f087f88c78 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:54.296991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66d9ab-9084-4878-892b-f1f087f88c78 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:54.298016 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66d9ab-9084-4878-892b-f1f087f88c78 None admin] PATH_INFO: `/v3/projects` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:54.299044 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66d9ab-9084-4878-892b-f1f087f88c78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:54.299550 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66d9ab-9084-4878-892b-f1f087f88c78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:54.301423 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66d9ab-9084-4878-892b-f1f087f88c78 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:54.315936 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 333/657] 10.222.0.39 () {56 vars in 1148 bytes} [Wed May 25 15:03:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:54.325541 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef5c76-3014-4b7f-9364-56f2dda77ec0 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:54.402148 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:54.411396 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694049b5-d637-4de3-b6d5-1fe53a0699d0 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:54.413828 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694049b5-d637-4de3-b6d5-1fe53a0699d0 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:54.414913 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694049b5-d637-4de3-b6d5-1fe53a0699d0 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:54.418216 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 334/658] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:54.424980 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e27e6-8556-4e8f-9adb-5924f10f6392 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:54.425471 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e27e6-8556-4e8f-9adb-5924f10f6392 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:54.425962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e27e6-8556-4e8f-9adb-5924f10f6392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:54.452997 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-419e27e6-8556-4e8f-9adb-5924f10f6392 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:54.454628 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-419e27e6-8556-4e8f-9adb-5924f10f6392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:54.506443 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef5c76-3014-4b7f-9364-56f2dda77ec0 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:54.548605 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 335/659] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:54.575169 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d3f26-8365-49b4-9c9a-f6534b5aaac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:54.576672 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d3f26-8365-49b4-9c9a-f6534b5aaac6 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:54.577455 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d3f26-8365-49b4-9c9a-f6534b5aaac6 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:54.577998 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d3f26-8365-49b4-9c9a-f6534b5aaac6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:54.579852 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d3f26-8365-49b4-9c9a-f6534b5aaac6 None admin] RBAC: Adding query filter params (role.id=ff521c95c8aa454ea3daa6bc36d055b1, scope.project.id=ff4afc67ebcf4840946ce41755f94bf0, user.id=33f6a22c123f48a09af2f78636a04699) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:54.581050 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d3f26-8365-49b4-9c9a-f6534b5aaac6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:54.582772 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d3f26-8365-49b4-9c9a-f6534b5aaac6 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:54.588446 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e27e6-8556-4e8f-9adb-5924f10f6392 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:54.590472 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 325/660] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:03:54 2022] GET /identity/v3/role_assignments?user.id=33f6a22c123f48a09af2f78636a04699&scope.project.id=ff4afc67ebcf4840946ce41755f94bf0&role.id=ff521c95c8aa454ea3daa6bc36d055b1 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:54.804175 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:54.815258 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f239b3-1289-4343-a270-256a82c5c338 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:54.815697 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f239b3-1289-4343-a270-256a82c5c338 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:54.816139 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f239b3-1289-4343-a270-256a82c5c338 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:54.819831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e27e6-8556-4e8f-9adb-5924f10f6392 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:54.822813 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 326/661] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:54.827920 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b3488-140c-462e-a8a4-f9ce249a6daf None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:54.828455 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b3488-140c-462e-a8a4-f9ce249a6daf None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:54.828929 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b3488-140c-462e-a8a4-f9ce249a6daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:54.856736 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-c07b3488-140c-462e-a8a4-f9ce249a6daf None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:54.858872 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-c07b3488-140c-462e-a8a4-f9ce249a6daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:54.885764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a92fa-9135-4d45-9bf0-74a5e91bb055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:54.887149 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a92fa-9135-4d45-9bf0-74a5e91bb055 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:54.887494 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a92fa-9135-4d45-9bf0-74a5e91bb055 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:54.887861 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a92fa-9135-4d45-9bf0-74a5e91bb055 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:54.888606 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a92fa-9135-4d45-9bf0-74a5e91bb055 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:54.890344 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6a92fa-9135-4d45-9bf0-74a5e91bb055 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:54.912553 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-fe6a92fa-9135-4d45-9bf0-74a5e91bb055 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:03:54.912553 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:54.912553 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:03:54.912553 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:03:54.912553 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:03:54.912553 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:03:54.912553 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:03:54.912553 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:03:54.912553 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:03:54.912553 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:54.912553 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:03:54.912553 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:54.912553 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:54.912553 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:54.912553 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:54.912553 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:54.914366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:54.914366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:54.914366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:54.914366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:54.914366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:54.914366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:54.914366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:54.914366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:03:54.914366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:03:54.914366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:03:54.914366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:03:54.914366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:54.914366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:54.914366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:54.914366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:54.914366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:54.916250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:54.916250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:54.916250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:54.916250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:54.916250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:54.916250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:54.916250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:54.916250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:54.916250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:54.916250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:54.916250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:54.916250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:03:54.916250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:03:54.916250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:03:54.916250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:54.916250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 336/662] 10.222.0.39 () {56 vars in 1129 bytes} [Wed May 25 15:03:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:03:54.922030 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a92fa-9135-4d45-9bf0-74a5e91bb055 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:55.004635 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 327/663] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:03:55.041654 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b3488-140c-462e-a8a4-f9ce249a6daf None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:55.057396 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6a92fa-9135-4d45-9bf0-74a5e91bb055 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:55.103686 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c91a0-c846-4780-a8e6-dca80944690b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:55.104373 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c91a0-c846-4780-a8e6-dca80944690b None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:55.104654 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c91a0-c846-4780-a8e6-dca80944690b None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:55.105358 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c91a0-c846-4780-a8e6-dca80944690b None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:55.106095 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c91a0-c846-4780-a8e6-dca80944690b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:55.106610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c91a0-c846-4780-a8e6-dca80944690b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:55.108136 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c91a0-c846-4780-a8e6-dca80944690b None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:55.114600 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 337/664] 10.222.0.39 () {56 vars in 1124 bytes} [Wed May 25 15:03:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:55.124292 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c91a0-c846-4780-a8e6-dca80944690b None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:55.143507 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:55.188200 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:55.214222 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b3488-140c-462e-a8a4-f9ce249a6daf None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:55.271574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7d261-42b5-4ef0-be9a-39614e01a328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:55.274706 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7d261-42b5-4ef0-be9a-39614e01a328 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:55.275461 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7d261-42b5-4ef0-be9a-39614e01a328 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:55.276168 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7d261-42b5-4ef0-be9a-39614e01a328 None admin] PATH_INFO: `/v3/services/network` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:55.279028 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7d261-42b5-4ef0-be9a-39614e01a328 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:55.285103 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7d261-42b5-4ef0-be9a-39614e01a328 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:55.307138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-31c7d261-42b5-4ef0-be9a-39614e01a328 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:03:55.307138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:55.307138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:03:55.307138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:03:55.307138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:03:55.307138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:03:55.307138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:03:55.307138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:03:55.307138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:03:55.307138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:55.307138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:03:55.307138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:55.307138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:55.307138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:55.307138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:55.307138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:55.307138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:55.309412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:55.309412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:55.309412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:55.309412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:55.309412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:55.309412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:55.309412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:03:55.309412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:03:55.309412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:03:55.309412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:03:55.309412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:55.309412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:55.309412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:55.309412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:55.309412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:55.309412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:55.311395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:55.311395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:03:55.311395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:55.311395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:55.311395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:55.311395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:55.311395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:55.311395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:55.311395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:55.311395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:55.311395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:03:55.311395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:03:55.311395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:03:55.311395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:03:55.311395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 328/665] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:03:55 2022] GET /identity/v3/services/network => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:03:55.317213 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7d261-42b5-4ef0-be9a-39614e01a328 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:55.363382 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c91a0-c846-4780-a8e6-dca80944690b None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:55.405423 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c01ab-6d23-4344-a311-2082b831eb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:55.406100 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c01ab-6d23-4344-a311-2082b831eb22 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:55.406548 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c01ab-6d23-4344-a311-2082b831eb22 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:55.406868 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c01ab-6d23-4344-a311-2082b831eb22 None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:55.407599 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c01ab-6d23-4344-a311-2082b831eb22 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:55.407911 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c01ab-6d23-4344-a311-2082b831eb22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:55.409320 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c01ab-6d23-4344-a311-2082b831eb22 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:55.422274 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 338/666] 10.222.0.39 () {56 vars in 1124 bytes} [Wed May 25 15:03:55 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:55.536356 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7d261-42b5-4ef0-be9a-39614e01a328 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:55.564693 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:55.607538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf87e8-076d-431b-a3ac-31eef3c1852a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:55.608693 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf87e8-076d-431b-a3ac-31eef3c1852a None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:55.609184 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf87e8-076d-431b-a3ac-31eef3c1852a None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:55.609702 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf87e8-076d-431b-a3ac-31eef3c1852a None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:55.611088 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf87e8-076d-431b-a3ac-31eef3c1852a None admin] RBAC: Adding query filter params (name=network) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:55.611645 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf87e8-076d-431b-a3ac-31eef3c1852a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:55.614297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf87e8-076d-431b-a3ac-31eef3c1852a None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:55.623734 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 329/667] 10.222.0.39 () {56 vars in 1112 bytes} [Wed May 25 15:03:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:55.634191 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c01ab-6d23-4344-a311-2082b831eb22 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:55.810940 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:55.834455 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c01ab-6d23-4344-a311-2082b831eb22 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:55.889885 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e8b5a-d7d0-4e91-a3da-e6095f6c5971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:55.890717 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e8b5a-d7d0-4e91-a3da-e6095f6c5971 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:55.891041 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e8b5a-d7d0-4e91-a3da-e6095f6c5971 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:55.891665 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e8b5a-d7d0-4e91-a3da-e6095f6c5971 None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:55.892022 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e8b5a-d7d0-4e91-a3da-e6095f6c5971 None admin] RBAC: Adding query filter params (type=network) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:55.892333 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e8b5a-d7d0-4e91-a3da-e6095f6c5971 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:55.893745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e8b5a-d7d0-4e91-a3da-e6095f6c5971 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:55.899614 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 339/668] 10.222.0.39 () {56 vars in 1112 bytes} [Wed May 25 15:03:55 2022] GET /identity/v3/services?type=network => generated 124 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:57.155111 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c8f14-d2a2-47bb-a56c-e1d3435706f9 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:57.155653 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c8f14-d2a2-47bb-a56c-e1d3435706f9 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:57.155987 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c8f14-d2a2-47bb-a56c-e1d3435706f9 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:57.158862 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 330/669] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:57.167584 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b016e-0335-45b1-a86e-dd9eed70f9f8 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:57.168094 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b016e-0335-45b1-a86e-dd9eed70f9f8 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:57.168654 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b016e-0335-45b1-a86e-dd9eed70f9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:57.194359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-133b016e-0335-45b1-a86e-dd9eed70f9f8 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:57.195577 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-133b016e-0335-45b1-a86e-dd9eed70f9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:57.279670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 340/670] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:57.303256 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c8f14-d2a2-47bb-a56c-e1d3435706f9 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:57.507734 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c8f14-d2a2-47bb-a56c-e1d3435706f9 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:57.573953 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e1515-d8ec-464d-acb3-8748b3c2895d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:57.575170 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e1515-d8ec-464d-acb3-8748b3c2895d None admin] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:57.575650 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e1515-d8ec-464d-acb3-8748b3c2895d None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:57.576126 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e1515-d8ec-464d-acb3-8748b3c2895d None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:57.577465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e1515-d8ec-464d-acb3-8748b3c2895d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:57.580607 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e1515-d8ec-464d-acb3-8748b3c2895d None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:57.608509 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 331/671] 10.222.0.39 () {60 vars in 1141 bytes} [Wed May 25 15:03:57 2022] POST /identity/v3/services => generated 242 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:03:57.730002 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdab6b-4815-459c-864d-ca4a36e67920 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:57.730609 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdab6b-4815-459c-864d-ca4a36e67920 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:57.731152 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdab6b-4815-459c-864d-ca4a36e67920 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:57.734182 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 341/672] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:57.743453 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec1716-38c1-4c14-8283-04ade0e58a34 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:57.743886 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec1716-38c1-4c14-8283-04ade0e58a34 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:57.744304 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec1716-38c1-4c14-8283-04ade0e58a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:57.775663 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-1fec1716-38c1-4c14-8283-04ade0e58a34 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:57.777728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-1fec1716-38c1-4c14-8283-04ade0e58a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:57.835390 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:57.890219 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 332/673] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:57 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:57.914405 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdab6b-4815-459c-864d-ca4a36e67920 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:58.018007 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6cd10-c681-45be-a535-f945f6944c61 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:58.018189 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6cd10-c681-45be-a535-f945f6944c61 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:58.018553 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6cd10-c681-45be-a535-f945f6944c61 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:58.020025 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 333/674] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:03:58.024434 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:58.029491 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0644eea-f704-40c7-9d06-ee3adbee579e None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:58.029791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0644eea-f704-40c7-9d06-ee3adbee579e None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:58.030105 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0644eea-f704-40c7-9d06-ee3adbee579e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:58.049467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdab6b-4815-459c-864d-ca4a36e67920 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:58.051892 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-d0644eea-f704-40c7-9d06-ee3adbee579e None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:58.053293 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-d0644eea-f704-40c7-9d06-ee3adbee579e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:58.092110 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261da718-16c9-4bc1-996d-dcac5db8c59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:58.093368 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261da718-16c9-4bc1-996d-dcac5db8c59e None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:58.094151 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261da718-16c9-4bc1-996d-dcac5db8c59e None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:58.094746 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261da718-16c9-4bc1-996d-dcac5db8c59e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:58.109514 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261da718-16c9-4bc1-996d-dcac5db8c59e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:03:58.118692 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-261da718-16c9-4bc1-996d-dcac5db8c59e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:03:58.118692 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:58.118692 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:58.118692 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:58.118692 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:58.118692 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:58.118692 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:58.118692 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:58.118692 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:58.118692 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:58.118692 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:58.118692 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:58.118692 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:03:58.118692 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:03:58.118692 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:03:58.118692 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:03:58.119711 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:03:58.119711 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:03:58.119711 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:03:58.119711 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:03:58.119711 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:58.119711 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:58.119711 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:58.119711 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:58.119711 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:58.119711 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:58.119711 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:58.119711 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:58.119711 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:58.119711 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:58.119711 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:58.119711 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:58.120582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:58.120582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:58.120582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:58.120582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:58.120582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:03:58.120582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:03:58.120582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:03:58.120582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:03:58.120582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:03:58.120582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:03:58.120582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:03:58.120582 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:58.123332 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 342/675] 10.222.0.39 () {56 vars in 1096 bytes} [Wed May 25 15:03:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:58.130919 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261da718-16c9-4bc1-996d-dcac5db8c59e None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:58.162267 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 334/676] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:58 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:58.179557 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0644eea-f704-40c7-9d06-ee3adbee579e None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:58.282232 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261da718-16c9-4bc1-996d-dcac5db8c59e None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:58.308789 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:58.323185 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7981e-dc38-4ff1-a58f-69d41cb93682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:58.323865 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7981e-dc38-4ff1-a58f-69d41cb93682 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:58.324225 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7981e-dc38-4ff1-a58f-69d41cb93682 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:58.324500 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7981e-dc38-4ff1-a58f-69d41cb93682 None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:58.325167 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7981e-dc38-4ff1-a58f-69d41cb93682 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:58.325474 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7981e-dc38-4ff1-a58f-69d41cb93682 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:58.326904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7981e-dc38-4ff1-a58f-69d41cb93682 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:58.333031 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0644eea-f704-40c7-9d06-ee3adbee579e None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:58.342940 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 343/677] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:03:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:58.342940 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be816ea-6fde-4097-b813-5a9a91392f13 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:58.342940 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be816ea-6fde-4097-b813-5a9a91392f13 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:58.342940 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be816ea-6fde-4097-b813-5a9a91392f13 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:58.342940 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 344/678] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:03:58.346272 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be816ea-6fde-4097-b813-5a9a91392f13 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:58.349542 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:58.397970 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98cde5-f367-426a-a778-e3b8ecdf86f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:58.398878 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98cde5-f367-426a-a778-e3b8ecdf86f8 None admin] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:58.399281 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98cde5-f367-426a-a778-e3b8ecdf86f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:58.399675 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98cde5-f367-426a-a778-e3b8ecdf86f8 None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:58.400553 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98cde5-f367-426a-a778-e3b8ecdf86f8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:58.402118 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98cde5-f367-426a-a778-e3b8ecdf86f8 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:58.417988 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 335/679] 10.222.0.39 () {60 vars in 1141 bytes} [Wed May 25 15:03:58 2022] POST /identity/v3/services => generated 251 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:03:58.419700 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14313f-2fc7-435b-a8ef-4c7f19b7ba48 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:58.419993 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14313f-2fc7-435b-a8ef-4c7f19b7ba48 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:58.420271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14313f-2fc7-435b-a8ef-4c7f19b7ba48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:58.443258 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-1e14313f-2fc7-435b-a8ef-4c7f19b7ba48 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:03:58.444542 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-1e14313f-2fc7-435b-a8ef-4c7f19b7ba48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:03:58.536825 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be816ea-6fde-4097-b813-5a9a91392f13 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:58.562898 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 336/680] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:03:58 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:03:58.581382 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14313f-2fc7-435b-a8ef-4c7f19b7ba48 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:58.583325 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39ed2a-a14a-48f3-86e9-b50290408822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:58.585837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39ed2a-a14a-48f3-86e9-b50290408822 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:58.586454 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39ed2a-a14a-48f3-86e9-b50290408822 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:58.586929 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39ed2a-a14a-48f3-86e9-b50290408822 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:58.603816 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39ed2a-a14a-48f3-86e9-b50290408822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:58.606611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39ed2a-a14a-48f3-86e9-b50290408822 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:58.629598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-8a39ed2a-a14a-48f3-86e9-b50290408822 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:58.629598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:58.629598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:58.629598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:58.629598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:58.629598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:58.629598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:58.629598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:58.629598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:58.629598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:58.629598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:58.629598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:58.629598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:58.629598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:58.629598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:58.630593 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:58.630593 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:58.630593 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:58.630593 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:58.630593 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:58.630593 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:58.630593 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:58.630593 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:58.630593 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:58.630593 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:58.630593 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:58.630593 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:58.630593 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:58.630593 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:58.630593 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:58.630593 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:58.630593 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:58.631511 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:58.631511 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:58.631511 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:58.631511 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:58.635829 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 345/681] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:58.636825 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39ed2a-a14a-48f3-86e9-b50290408822 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:58.711540 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:58.742978 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:58.775623 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14313f-2fc7-435b-a8ef-4c7f19b7ba48 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:58.788111 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39ed2a-a14a-48f3-86e9-b50290408822 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:58.839046 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab8a3f-0d27-4fa2-9a39-7a96c8f77cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:58.839306 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242441b-aa37-4d20-8bf7-847f97f91ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:58.839904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab8a3f-0d27-4fa2-9a39-7a96c8f77cea None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:58.840197 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab8a3f-0d27-4fa2-9a39-7a96c8f77cea None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:58.840484 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab8a3f-0d27-4fa2-9a39-7a96c8f77cea None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:58.840857 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242441b-aa37-4d20-8bf7-847f97f91ae2 None admin] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:58.841425 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab8a3f-0d27-4fa2-9a39-7a96c8f77cea None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:58.841542 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242441b-aa37-4d20-8bf7-847f97f91ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:58.841740 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab8a3f-0d27-4fa2-9a39-7a96c8f77cea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:58.842130 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242441b-aa37-4d20-8bf7-847f97f91ae2 None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:58.843240 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab8a3f-0d27-4fa2-9a39-7a96c8f77cea None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:58.843741 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242441b-aa37-4d20-8bf7-847f97f91ae2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:58.846351 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242441b-aa37-4d20-8bf7-847f97f91ae2 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:58.860816 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 346/682] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:58.866449 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab8a3f-0d27-4fa2-9a39-7a96c8f77cea None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:58.872035 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 337/683] 10.222.0.39 () {60 vars in 1141 bytes} [Wed May 25 15:03:58 2022] POST /identity/v3/services => generated 240 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:03:59.064824 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab8a3f-0d27-4fa2-9a39-7a96c8f77cea None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:59.088286 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:59.139586 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c78c3-1989-4e98-814e-58674a57de5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:59.140666 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c78c3-1989-4e98-814e-58674a57de5d None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:59.140956 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c78c3-1989-4e98-814e-58674a57de5d None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:59.141234 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c78c3-1989-4e98-814e-58674a57de5d None admin] PATH_INFO: `/v3/users/nova` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:59.151216 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c78c3-1989-4e98-814e-58674a57de5d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:59.152792 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c78c3-1989-4e98-814e-58674a57de5d None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:59.168525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-2b6c78c3-1989-4e98-814e-58674a57de5d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 15:03:59.168525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:59.168525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:59.168525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:59.168525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:59.168525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:59.168525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:59.168525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:59.168525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:59.168525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:59.168525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:59.168525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:59.168525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:03:59.168525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:03:59.168525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:03:59.168525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:03:59.169695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:59.169695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:59.169695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:03:59.169695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:59.169695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:03:59.169695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:03:59.169695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:59.169695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:59.169695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:59.169695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:59.169695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:59.169695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:59.169695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:59.169695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:59.169695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:59.169695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:59.169695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:59.169695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:59.170779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:59.170779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:59.170779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:03:59.170779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:03:59.170779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:03:59.170779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:03:59.170779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:03:59.170779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:03:59.170779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 15:03:59.170779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:59.173282 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 347/684] 10.222.0.39 () {56 vars in 1093 bytes} [Wed May 25 15:03:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:03:59.178707 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242441b-aa37-4d20-8bf7-847f97f91ae2 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:59.305331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242441b-aa37-4d20-8bf7-847f97f91ae2 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:59.351858 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbe7c8-65c2-47f0-bfd9-f65b0b1bc4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:59.352557 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbe7c8-65c2-47f0-bfd9-f65b0b1bc4df None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:59.352841 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbe7c8-65c2-47f0-bfd9-f65b0b1bc4df None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:59.353120 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbe7c8-65c2-47f0-bfd9-f65b0b1bc4df None admin] PATH_INFO: `/v3/users` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:59.353972 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fbe7c8-65c2-47f0-bfd9-f65b0b1bc4df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:59.354334 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fbe7c8-65c2-47f0-bfd9-f65b0b1bc4df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:59.355872 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fbe7c8-65c2-47f0-bfd9-f65b0b1bc4df None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:59.373184 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:59.378665 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 338/685] 10.222.0.39 () {56 vars in 1133 bytes} [Wed May 25 15:03:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:03:59.384684 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c78c3-1989-4e98-814e-58674a57de5d None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:59.498921 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c78c3-1989-4e98-814e-58674a57de5d None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:59.535476 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b8742-965a-40d1-82d4-81a0baf9a53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:59.536293 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b8742-965a-40d1-82d4-81a0baf9a53d None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:59.536669 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b8742-965a-40d1-82d4-81a0baf9a53d None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:59.536838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b8742-965a-40d1-82d4-81a0baf9a53d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:59.549355 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b8742-965a-40d1-82d4-81a0baf9a53d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:59.550907 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b8742-965a-40d1-82d4-81a0baf9a53d None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:59.569172 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-4a7b8742-965a-40d1-82d4-81a0baf9a53d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:59.569172 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:59.569172 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:59.569172 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:59.569172 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:59.569172 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:59.569172 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:59.569172 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:59.569172 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:59.569172 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:59.569172 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:59.569172 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:59.569172 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:03:59.569172 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:03:59.569172 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:03:59.571018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:03:59.571018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:59.571018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:59.571018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:59.571018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:59.571018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:59.571018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:59.571018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:59.571018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:59.571018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:59.571018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:59.571018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:59.571018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:59.571018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:59.571018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:59.571018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:59.571018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:59.572717 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:03:59.572717 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:03:59.572717 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:03:59.572717 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:59.572717 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 348/686] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:59.579803 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbe7c8-65c2-47f0-bfd9-f65b0b1bc4df None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:59.695079 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbe7c8-65c2-47f0-bfd9-f65b0b1bc4df None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:59.734179 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46989bde-3f30-4747-9096-773bab8e8a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:59.735811 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46989bde-3f30-4747-9096-773bab8e8a4c None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:59.736609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46989bde-3f30-4747-9096-773bab8e8a4c None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:59.737192 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46989bde-3f30-4747-9096-773bab8e8a4c None admin] PATH_INFO: `/v3/domains` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:59.738157 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46989bde-3f30-4747-9096-773bab8e8a4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:03:59.738819 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46989bde-3f30-4747-9096-773bab8e8a4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:59.740511 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46989bde-3f30-4747-9096-773bab8e8a4c None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:59.757829 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 339/687] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:03:59.767425 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b8742-965a-40d1-82d4-81a0baf9a53d None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:03:59.791612 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:03:59.895771 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b8742-965a-40d1-82d4-81a0baf9a53d None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:03:59.932791 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d7fcf-cbe0-4102-8f1c-9b784e4a4a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:03:59.933617 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d7fcf-cbe0-4102-8f1c-9b784e4a4a36 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:03:59.933895 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d7fcf-cbe0-4102-8f1c-9b784e4a4a36 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:03:59.934167 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d7fcf-cbe0-4102-8f1c-9b784e4a4a36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:03:59.942528 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d7fcf-cbe0-4102-8f1c-9b784e4a4a36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:03:59.944000 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d7fcf-cbe0-4102-8f1c-9b784e4a4a36 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:03:59.959547 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-8a9d7fcf-cbe0-4102-8f1c-9b784e4a4a36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:59.959547 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:03:59.959547 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:03:59.959547 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:03:59.959547 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:03:59.959547 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:03:59.959547 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:03:59.959547 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:03:59.959547 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:03:59.959547 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:03:59.959547 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:03:59.959547 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:03:59.959547 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:03:59.959547 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:03:59.959547 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:03:59.960473 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:03:59.960473 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:03:59.960473 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:03:59.960473 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:03:59.960473 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:03:59.960473 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:03:59.960473 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:03:59.960473 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:03:59.960473 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:03:59.960473 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:03:59.960473 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:03:59.960473 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:03:59.960473 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:03:59.960473 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:03:59.960473 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:03:59.960473 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:03:59.960473 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:03:59.961340 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:03:59.961340 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:03:59.961340 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:03:59.961340 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:03:59.961340 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:03:59.961340 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:03:59.961340 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:03:59.961340 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:03:59.961340 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 349/688] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:03:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:03:59.967645 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46989bde-3f30-4747-9096-773bab8e8a4c None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:00.034042 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:00.057274 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064af37e-8ee1-45c2-b056-10ac99851939 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:00.057592 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064af37e-8ee1-45c2-b056-10ac99851939 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:00.057832 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064af37e-8ee1-45c2-b056-10ac99851939 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:00.059553 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 350/689] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:04:00.065128 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd89e17-cc08-42f6-8f02-ad6e46b9bb16 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:00.065409 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd89e17-cc08-42f6-8f02-ad6e46b9bb16 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:00.065676 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd89e17-cc08-42f6-8f02-ad6e46b9bb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:00.080621 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46989bde-3f30-4747-9096-773bab8e8a4c None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:00.083561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-efd89e17-cc08-42f6-8f02-ad6e46b9bb16 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:00.084775 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-efd89e17-cc08-42f6-8f02-ad6e46b9bb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:00.118051 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692471d3-9528-4d02-a2f8-e53098a2f61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:00.118789 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692471d3-9528-4d02-a2f8-e53098a2f61a None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:00.119122 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692471d3-9528-4d02-a2f8-e53098a2f61a None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:00.119401 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692471d3-9528-4d02-a2f8-e53098a2f61a None admin] PATH_INFO: `/v3/projects` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:00.120200 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692471d3-9528-4d02-a2f8-e53098a2f61a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:00.120514 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692471d3-9528-4d02-a2f8-e53098a2f61a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:00.121962 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692471d3-9528-4d02-a2f8-e53098a2f61a None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:00.136393 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 340/690] 10.222.0.39 () {56 vars in 1148 bytes} [Wed May 25 15:03:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:00.142701 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692471d3-9528-4d02-a2f8-e53098a2f61a None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:00.170353 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 351/691] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:04:00 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:04:00.184856 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd89e17-cc08-42f6-8f02-ad6e46b9bb16 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:00.195669 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:00.256970 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692471d3-9528-4d02-a2f8-e53098a2f61a None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:00.286663 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:00.293304 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd89e17-cc08-42f6-8f02-ad6e46b9bb16 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:00.299046 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9b2a1-2854-4a65-a3b7-ae6ee396820e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:00.299982 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9b2a1-2854-4a65-a3b7-ae6ee396820e None admin] REQUEST_METHOD: `PUT` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:00.300319 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9b2a1-2854-4a65-a3b7-ae6ee396820e None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:00.300700 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9b2a1-2854-4a65-a3b7-ae6ee396820e None admin] PATH_INFO: `/v3/projects/ff4afc67ebcf4840946ce41755f94bf0/users/33f6a22c123f48a09af2f78636a04699/roles/ff521c95c8aa454ea3daa6bc36d055b1` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:00.304071 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9b2a1-2854-4a65-a3b7-ae6ee396820e None admin] RBAC: Authorizing `identity:create_grant(project_id=ff4afc67ebcf4840946ce41755f94bf0, user_id=33f6a22c123f48a09af2f78636a04699, role_id=ff521c95c8aa454ea3daa6bc36d055b1)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:00.305673 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9b2a1-2854-4a65-a3b7-ae6ee396820e None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:00.326331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 341/692] 10.222.0.39 () {58 vars in 1439 bytes} [Wed May 25 15:04:00 2022] PUT /identity/v3/projects/ff4afc67ebcf4840946ce41755f94bf0/users/33f6a22c123f48a09af2f78636a04699/roles/ff521c95c8aa454ea3daa6bc36d055b1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:04:00.342865 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1b666-b124-48cf-9cf4-0058bc00a81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:00.343940 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1b666-b124-48cf-9cf4-0058bc00a81a None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:00.344224 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1b666-b124-48cf-9cf4-0058bc00a81a None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:00.344501 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1b666-b124-48cf-9cf4-0058bc00a81a None admin] PATH_INFO: `/v3/services/image` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:00.345275 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1b666-b124-48cf-9cf4-0058bc00a81a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:00.346940 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1b666-b124-48cf-9cf4-0058bc00a81a None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:00.360647 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-0ec1b666-b124-48cf-9cf4-0058bc00a81a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:04:00.360647 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:00.360647 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:04:00.360647 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:04:00.360647 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:04:00.360647 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:04:00.360647 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:04:00.360647 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:00.360647 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:04:00.360647 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:00.360647 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:04:00.360647 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:00.360647 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:00.360647 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:00.360647 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:00.360647 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:00.360647 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:00.361795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:00.361795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:00.361795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:00.361795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:00.361795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:00.361795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:00.361795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:04:00.361795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:04:00.361795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:04:00.361795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:04:00.361795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:00.361795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:00.361795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:00.361795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:00.361795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:00.361795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:00.362680 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:00.362680 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:04:00.362680 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:00.362680 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:00.362680 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:00.362680 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:00.362680 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:00.362680 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:00.362680 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:00.362680 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:00.362680 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:04:00.362680 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:00.362680 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:04:00.362680 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:00.368759 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 352/693] 10.222.0.39 () {56 vars in 1105 bytes} [Wed May 25 15:04:00 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:04:00.370428 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9b2a1-2854-4a65-a3b7-ae6ee396820e None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:00.514098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9b2a1-2854-4a65-a3b7-ae6ee396820e None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:00.556667 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4e269-afd5-4896-9974-daa99f860497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:00.557362 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4e269-afd5-4896-9974-daa99f860497 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:00.557648 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4e269-afd5-4896-9974-daa99f860497 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:00.557923 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4e269-afd5-4896-9974-daa99f860497 None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:00.558679 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4e269-afd5-4896-9974-daa99f860497 None admin] RBAC: Adding query filter params (name=image) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:00.558987 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4e269-afd5-4896-9974-daa99f860497 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:00.560379 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4e269-afd5-4896-9974-daa99f860497 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:00.566620 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 342/694] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:04:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:04:00.572762 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1b666-b124-48cf-9cf4-0058bc00a81a None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:00.655005 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:00.689772 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1b666-b124-48cf-9cf4-0058bc00a81a None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:00.729861 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7744453-d26a-4560-9464-b4f4a80c0dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:00.730648 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7744453-d26a-4560-9464-b4f4a80c0dc1 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:00.730930 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7744453-d26a-4560-9464-b4f4a80c0dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:00.731208 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7744453-d26a-4560-9464-b4f4a80c0dc1 None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:00.731930 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7744453-d26a-4560-9464-b4f4a80c0dc1 None admin] RBAC: Adding query filter params (type=image) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:00.732243 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7744453-d26a-4560-9464-b4f4a80c0dc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:00.733643 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7744453-d26a-4560-9464-b4f4a80c0dc1 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:00.740183 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 353/695] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:04:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:04:00.746349 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4e269-afd5-4896-9974-daa99f860497 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:00.798437 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:00.870076 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4e269-afd5-4896-9974-daa99f860497 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:00.910358 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34746e9-8667-434f-8fb3-6e6436660f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:00.911301 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34746e9-8667-434f-8fb3-6e6436660f81 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:00.911759 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34746e9-8667-434f-8fb3-6e6436660f81 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:00.912186 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34746e9-8667-434f-8fb3-6e6436660f81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:00.913129 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34746e9-8667-434f-8fb3-6e6436660f81 None admin] RBAC: Adding query filter params (interface=public, service_id=de43986457644b6f949147f2d18ff9dd, region_id=RegionOne) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:00.913589 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34746e9-8667-434f-8fb3-6e6436660f81 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:00.915158 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34746e9-8667-434f-8fb3-6e6436660f81 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:00.924765 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 343/696] 10.222.0.39 () {56 vars in 1251 bytes} [Wed May 25 15:04:00 2022] GET /identity/v3/endpoints?service_id=de43986457644b6f949147f2d18ff9dd&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:00.930533 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7744453-d26a-4560-9464-b4f4a80c0dc1 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:01.044961 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7744453-d26a-4560-9464-b4f4a80c0dc1 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:01.060000 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a1c4d-9260-4c47-b553-3c6cd6334548 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:01.060385 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a1c4d-9260-4c47-b553-3c6cd6334548 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:01.060651 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a1c4d-9260-4c47-b553-3c6cd6334548 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:01.062120 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 344/697] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:01.075723 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c060aab-8349-48c7-b90c-3a6ee69c8c40 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:01.075723 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c060aab-8349-48c7-b90c-3a6ee69c8c40 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:01.075723 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c060aab-8349-48c7-b90c-3a6ee69c8c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:01.089586 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-8c060aab-8349-48c7-b90c-3a6ee69c8c40 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:01.090813 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-8c060aab-8349-48c7-b90c-3a6ee69c8c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:01.104080 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fb36a-90b9-424c-bcc0-d8e5d528de0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:01.105223 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fb36a-90b9-424c-bcc0-d8e5d528de0d None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:01.105719 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fb36a-90b9-424c-bcc0-d8e5d528de0d None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:01.106497 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fb36a-90b9-424c-bcc0-d8e5d528de0d None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:01.107613 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0fb36a-90b9-424c-bcc0-d8e5d528de0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:01.110227 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0fb36a-90b9-424c-bcc0-d8e5d528de0d None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:01.116183 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:01.122478 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 354/698] 10.222.0.39 () {56 vars in 1087 bytes} [Wed May 25 15:04:00 2022] GET /identity/v3/services => generated 1002 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:04:01.202327 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 345/699] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:04:01 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:04:01.245498 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fb36a-90b9-424c-bcc0-d8e5d528de0d None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:01.384393 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fb36a-90b9-424c-bcc0-d8e5d528de0d None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:01.423311 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd94f6-9e28-4d97-9147-e236346644cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:01.424178 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd94f6-9e28-4d97-9147-e236346644cb None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:01.424459 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd94f6-9e28-4d97-9147-e236346644cb None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:01.424734 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd94f6-9e28-4d97-9147-e236346644cb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:01.425395 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd94f6-9e28-4d97-9147-e236346644cb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:01.426809 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd94f6-9e28-4d97-9147-e236346644cb None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:01.440304 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-0ccd94f6-9e28-4d97-9147-e236346644cb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:04:01.440304 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:01.440304 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:04:01.440304 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:04:01.440304 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:04:01.440304 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:04:01.440304 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:04:01.440304 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:01.440304 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:04:01.440304 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:01.440304 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:04:01.440304 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:01.440304 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:01.440304 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:01.440304 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:01.440304 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:01.441293 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:01.441293 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:01.441293 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:01.441293 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:01.441293 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:01.441293 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:01.441293 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:01.441293 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:04:01.441293 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:04:01.441293 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:04:01.441293 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:04:01.441293 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:01.441293 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:01.441293 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:01.441293 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:01.441293 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:01.442131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:01.442131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:01.442131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:04:01.442131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:01.442131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:01.442131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:01.442131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:01.442131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:01.442131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:01.442131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:01.442131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:01.442131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:04:01.442131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:01.442131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:04:01.442131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:01.442131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 355/700] 10.222.0.39 () {56 vars in 1129 bytes} [Wed May 25 15:04:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:01.453582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c060aab-8349-48c7-b90c-3a6ee69c8c40 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:01.533330 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:01.607589 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c060aab-8349-48c7-b90c-3a6ee69c8c40 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:01.652581 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489e1bb-4c33-4dd3-b3c4-65945853fbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:01.653565 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489e1bb-4c33-4dd3-b3c4-65945853fbc5 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:01.654065 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489e1bb-4c33-4dd3-b3c4-65945853fbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:01.654518 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489e1bb-4c33-4dd3-b3c4-65945853fbc5 None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:01.655496 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489e1bb-4c33-4dd3-b3c4-65945853fbc5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:01.656365 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489e1bb-4c33-4dd3-b3c4-65945853fbc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:01.658113 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489e1bb-4c33-4dd3-b3c4-65945853fbc5 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:01.664318 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 346/701] 10.222.0.39 () {56 vars in 1124 bytes} [Wed May 25 15:04:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:01.675452 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd94f6-9e28-4d97-9147-e236346644cb None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:01.763352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:01.805664 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd94f6-9e28-4d97-9147-e236346644cb None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:01.841106 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114d4b5-fa19-43f6-89c5-aa19bced4b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:01.841890 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114d4b5-fa19-43f6-89c5-aa19bced4b75 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:01.842170 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114d4b5-fa19-43f6-89c5-aa19bced4b75 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:01.842470 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114d4b5-fa19-43f6-89c5-aa19bced4b75 None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:01.843171 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114d4b5-fa19-43f6-89c5-aa19bced4b75 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:01.843583 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114d4b5-fa19-43f6-89c5-aa19bced4b75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:01.844958 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114d4b5-fa19-43f6-89c5-aa19bced4b75 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:01.853718 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 356/702] 10.222.0.39 () {56 vars in 1124 bytes} [Wed May 25 15:04:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:01.863016 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489e1bb-4c33-4dd3-b3c4-65945853fbc5 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:01.984583 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489e1bb-4c33-4dd3-b3c4-65945853fbc5 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:01.986537 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:02.030263 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d9d65-96f6-4c77-8baf-e1e07caaa71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:02.031017 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d9d65-96f6-4c77-8baf-e1e07caaa71d None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:02.031337 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d9d65-96f6-4c77-8baf-e1e07caaa71d None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:02.031821 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d9d65-96f6-4c77-8baf-e1e07caaa71d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:02.032856 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d9d65-96f6-4c77-8baf-e1e07caaa71d None admin] RBAC: Adding query filter params (interface=public, service_id=31533f0521b34c9497ecd4d6f921148a, region_id=RegionOne) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:02.033176 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d9d65-96f6-4c77-8baf-e1e07caaa71d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:02.034663 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d9d65-96f6-4c77-8baf-e1e07caaa71d None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:02.041425 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 347/703] 10.222.0.39 () {56 vars in 1251 bytes} [Wed May 25 15:04:01 2022] GET /identity/v3/endpoints?service_id=31533f0521b34c9497ecd4d6f921148a&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:02.047509 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114d4b5-fa19-43f6-89c5-aa19bced4b75 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:02.167694 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114d4b5-fa19-43f6-89c5-aa19bced4b75 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:02.197319 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:02.206041 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d41286-5a87-4e5c-b512-919377b5c717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:02.206754 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d41286-5a87-4e5c-b512-919377b5c717 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:02.207037 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d41286-5a87-4e5c-b512-919377b5c717 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:02.207309 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d41286-5a87-4e5c-b512-919377b5c717 None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:02.207996 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d41286-5a87-4e5c-b512-919377b5c717 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:02.209390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d41286-5a87-4e5c-b512-919377b5c717 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:02.215914 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 357/704] 10.222.0.39 () {56 vars in 1087 bytes} [Wed May 25 15:04:02 2022] GET /identity/v3/services => generated 1002 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:04:02.339240 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14278a-b184-45a5-a645-dc8f505571c2 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:02.339924 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14278a-b184-45a5-a645-dc8f505571c2 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:02.340406 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14278a-b184-45a5-a645-dc8f505571c2 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:02.342552 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 348/705] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:02.350766 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6349fd-a4ea-48bc-b6bb-f7aa104814f1 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:02.351249 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6349fd-a4ea-48bc-b6bb-f7aa104814f1 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:02.351717 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6349fd-a4ea-48bc-b6bb-f7aa104814f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:02.379557 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-cc6349fd-a4ea-48bc-b6bb-f7aa104814f1 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:02.381527 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-cc6349fd-a4ea-48bc-b6bb-f7aa104814f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:02.495191 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 358/706] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:04:02 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:04:02.534201 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14278a-b184-45a5-a645-dc8f505571c2 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:02.700067 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14278a-b184-45a5-a645-dc8f505571c2 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:02.741797 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbe081-3fa1-4ebb-bf8f-86055fd33084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:02.743150 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbe081-3fa1-4ebb-bf8f-86055fd33084 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:02.743639 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbe081-3fa1-4ebb-bf8f-86055fd33084 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:02.744216 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbe081-3fa1-4ebb-bf8f-86055fd33084 None admin] PATH_INFO: `/v3/services/network` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:02.745082 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbe081-3fa1-4ebb-bf8f-86055fd33084 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:02.746808 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbe081-3fa1-4ebb-bf8f-86055fd33084 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:02.760641 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-4adbe081-3fa1-4ebb-bf8f-86055fd33084 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:04:02.760641 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:02.760641 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:04:02.760641 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:04:02.760641 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:04:02.760641 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:04:02.760641 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:04:02.760641 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:02.760641 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:04:02.760641 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:02.760641 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:04:02.760641 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:02.760641 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:02.760641 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:02.760641 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:02.760641 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:02.760641 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:02.761698 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:02.761698 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:02.761698 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:02.761698 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:02.761698 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:02.761698 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:02.761698 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:04:02.761698 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:04:02.761698 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:04:02.761698 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:04:02.761698 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:02.761698 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:02.761698 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:02.761698 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:02.761698 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:02.761698 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:02.762558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:02.762558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:04:02.762558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:02.762558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:02.762558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:02.762558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:02.762558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:02.762558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:02.762558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:02.762558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:02.762558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:04:02.762558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:02.762558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:04:02.762558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:02.765693 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 349/707] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:04:02 2022] GET /identity/v3/services/network => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:02.776986 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6349fd-a4ea-48bc-b6bb-f7aa104814f1 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:02.964234 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6349fd-a4ea-48bc-b6bb-f7aa104814f1 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:03.004861 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:03.024823 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5edf70-82b4-4cf6-9ac4-5d39c9722676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:03.025944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5edf70-82b4-4cf6-9ac4-5d39c9722676 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:03.026422 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5edf70-82b4-4cf6-9ac4-5d39c9722676 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:03.026871 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5edf70-82b4-4cf6-9ac4-5d39c9722676 None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:03.028038 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5edf70-82b4-4cf6-9ac4-5d39c9722676 None admin] RBAC: Adding query filter params (name=network) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:03.028519 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5edf70-82b4-4cf6-9ac4-5d39c9722676 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:03.031116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5edf70-82b4-4cf6-9ac4-5d39c9722676 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:03.040384 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 359/708] 10.222.0.39 () {56 vars in 1112 bytes} [Wed May 25 15:04:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:03.049049 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbe081-3fa1-4ebb-bf8f-86055fd33084 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:03.103738 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:03.242684 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbe081-3fa1-4ebb-bf8f-86055fd33084 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:03.302442 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf3841-21ce-44de-aec2-f80204f9a6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:03.304006 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf3841-21ce-44de-aec2-f80204f9a6d8 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:03.304504 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf3841-21ce-44de-aec2-f80204f9a6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:03.304980 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf3841-21ce-44de-aec2-f80204f9a6d8 None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:03.306590 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf3841-21ce-44de-aec2-f80204f9a6d8 None admin] RBAC: Adding query filter params (type=network) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:03.307133 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf3841-21ce-44de-aec2-f80204f9a6d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:03.309663 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf3841-21ce-44de-aec2-f80204f9a6d8 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:03.321986 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 350/709] 10.222.0.39 () {56 vars in 1112 bytes} [Wed May 25 15:04:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:03.328532 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ea8ed-fb9d-4a2c-9266-334f7e2f2806 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:03.329106 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ea8ed-fb9d-4a2c-9266-334f7e2f2806 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:03.329566 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ea8ed-fb9d-4a2c-9266-334f7e2f2806 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:03.330662 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf3841-21ce-44de-aec2-f80204f9a6d8 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:03.332775 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 360/710] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:04:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:03.338885 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd648206-e460-4e92-9745-e6b17bbbd7d6 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:03.339173 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd648206-e460-4e92-9745-e6b17bbbd7d6 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:03.339449 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd648206-e460-4e92-9745-e6b17bbbd7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:03.357734 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-cd648206-e460-4e92-9745-e6b17bbbd7d6 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:03.359032 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-cd648206-e460-4e92-9745-e6b17bbbd7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:03.450698 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 361/711] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:04:03 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:04:03.452872 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:03.462304 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf3841-21ce-44de-aec2-f80204f9a6d8 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:03.472225 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd648206-e460-4e92-9745-e6b17bbbd7d6 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:03.511852 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cc3b8-58a5-42c0-9178-98182cae3595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:03.512900 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cc3b8-58a5-42c0-9178-98182cae3595 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:03.513330 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cc3b8-58a5-42c0-9178-98182cae3595 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:03.513755 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cc3b8-58a5-42c0-9178-98182cae3595 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:03.514967 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cc3b8-58a5-42c0-9178-98182cae3595 None admin] RBAC: Adding query filter params (interface=public, service_id=b44eaf89682e41fcbf78c45db0d89b0b, region_id=RegionOne) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:03.515609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cc3b8-58a5-42c0-9178-98182cae3595 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:03.517396 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cc3b8-58a5-42c0-9178-98182cae3595 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:03.529926 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 351/712] 10.222.0.39 () {56 vars in 1251 bytes} [Wed May 25 15:04:03 2022] GET /identity/v3/endpoints?service_id=b44eaf89682e41fcbf78c45db0d89b0b&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:03.532074 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cc3b8-58a5-42c0-9178-98182cae3595 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:03.600758 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd648206-e460-4e92-9745-e6b17bbbd7d6 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:03.623928 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:03.657231 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead180e-93a2-49fe-8df0-2addab384834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:03.659147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead180e-93a2-49fe-8df0-2addab384834 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:03.659961 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead180e-93a2-49fe-8df0-2addab384834 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:03.660415 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead180e-93a2-49fe-8df0-2addab384834 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:03.676651 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead180e-93a2-49fe-8df0-2addab384834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:04:03.685891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-3ead180e-93a2-49fe-8df0-2addab384834 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:04:03.685891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:03.685891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:03.685891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:03.685891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:03.685891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:03.685891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:03.685891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:03.685891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:03.685891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:03.685891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:03.685891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:03.685891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:04:03.685891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:04:03.685891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:04:03.685891 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:04:03.687067 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:04:03.687067 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:04:03.687067 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:04:03.687067 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:04:03.687067 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:03.687067 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:03.687067 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:03.687067 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:03.687067 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:03.687067 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:03.687067 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:03.687067 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:04:03.687067 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:03.687067 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:03.687067 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:03.687067 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:03.687901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:03.687901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:03.687901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:03.687901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:03.687901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:04:03.687901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:04:03.687901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:04:03.687901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:04:03.687901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:04:03.687901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:04:03.687901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:04:03.687901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:03.692013 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 362/713] 10.222.0.39 () {56 vars in 1096 bytes} [Wed May 25 15:04:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:03.693000 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead180e-93a2-49fe-8df0-2addab384834 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:03.705273 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cc3b8-58a5-42c0-9178-98182cae3595 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:03.755409 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f8024-9f7c-4a94-a6ff-2a0880d3e365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:03.756798 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f8024-9f7c-4a94-a6ff-2a0880d3e365 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:03.757283 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f8024-9f7c-4a94-a6ff-2a0880d3e365 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:03.757994 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f8024-9f7c-4a94-a6ff-2a0880d3e365 None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:03.759548 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f8024-9f7c-4a94-a6ff-2a0880d3e365 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:03.762034 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f8024-9f7c-4a94-a6ff-2a0880d3e365 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:03.778554 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 352/714] 10.222.0.39 () {56 vars in 1087 bytes} [Wed May 25 15:04:03 2022] GET /identity/v3/services => generated 1002 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:04:03.831102 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead180e-93a2-49fe-8df0-2addab384834 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:03.896560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d98c0-8ca9-4f1a-8199-7a38bddb4415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:03.897756 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d98c0-8ca9-4f1a-8199-7a38bddb4415 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:03.898265 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d98c0-8ca9-4f1a-8199-7a38bddb4415 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:03.898766 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d98c0-8ca9-4f1a-8199-7a38bddb4415 None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:03.900203 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d98c0-8ca9-4f1a-8199-7a38bddb4415 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:03.900528 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d98c0-8ca9-4f1a-8199-7a38bddb4415 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:03.901994 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d98c0-8ca9-4f1a-8199-7a38bddb4415 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:03.917353 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 363/715] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:04:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:03.922966 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f8024-9f7c-4a94-a6ff-2a0880d3e365 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:03.931615 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fef48-7435-4241-88e0-b293a67db0a1 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:03.932049 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fef48-7435-4241-88e0-b293a67db0a1 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:03.932510 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fef48-7435-4241-88e0-b293a67db0a1 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:03.935328 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 364/716] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:04:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:03.943716 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d60ee-bf1c-4f70-8f9a-39bbe5cffcdf None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:03.944079 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d60ee-bf1c-4f70-8f9a-39bbe5cffcdf None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:03.944277 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d60ee-bf1c-4f70-8f9a-39bbe5cffcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:03.952076 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:03.977476 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-675d60ee-bf1c-4f70-8f9a-39bbe5cffcdf None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:03.980905 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-675d60ee-bf1c-4f70-8f9a-39bbe5cffcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:04.040382 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:04.046039 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f8024-9f7c-4a94-a6ff-2a0880d3e365 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:04.088745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4692efe-35d5-471a-9cfc-abe0ae1effdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:04.089793 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4692efe-35d5-471a-9cfc-abe0ae1effdf None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:04.090100 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4692efe-35d5-471a-9cfc-abe0ae1effdf None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:04.090414 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4692efe-35d5-471a-9cfc-abe0ae1effdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:04.091705 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 365/717] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:04:03 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:04:04.106983 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4692efe-35d5-471a-9cfc-abe0ae1effdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:04.108468 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4692efe-35d5-471a-9cfc-abe0ae1effdf None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:04.127773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-d4692efe-35d5-471a-9cfc-abe0ae1effdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:04.127773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:04.127773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:04.127773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:04.127773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:04.127773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:04.127773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:04.127773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:04.127773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:04.127773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:04.127773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:04.127773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:04.127773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:04:04.127773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:04:04.127773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:04:04.129371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:04:04.129371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:04.129371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:04.129371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:04.129371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:04.129371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:04.129371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:04.129371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:04.129371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:04:04.129371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:04.129371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:04.129371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:04.129371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:04.129371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:04.129371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:04.129371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:04.129371 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:04.132432 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:04:04.132432 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:04:04.132432 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:04.132432 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:04.132432 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 353/718] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:04:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:04.136085 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d60ee-bf1c-4f70-8f9a-39bbe5cffcdf None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:04.139147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4692efe-35d5-471a-9cfc-abe0ae1effdf None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:04.276766 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d60ee-bf1c-4f70-8f9a-39bbe5cffcdf None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:04.281778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:04.324669 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c8251-9650-42b8-b96c-1d46e1b3ae88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:04.325366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c8251-9650-42b8-b96c-1d46e1b3ae88 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:04.325648 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c8251-9650-42b8-b96c-1d46e1b3ae88 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:04.325922 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c8251-9650-42b8-b96c-1d46e1b3ae88 None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:04.326701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c8251-9650-42b8-b96c-1d46e1b3ae88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:04.327009 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c8251-9650-42b8-b96c-1d46e1b3ae88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:04.329204 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c8251-9650-42b8-b96c-1d46e1b3ae88 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:04.332933 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4692efe-35d5-471a-9cfc-abe0ae1effdf None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:04.349187 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 366/719] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:04.350286 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c8251-9650-42b8-b96c-1d46e1b3ae88 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:04.385571 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:04.405311 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73301254-a473-433f-92cc-95c4698d32d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:04.407291 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73301254-a473-433f-92cc-95c4698d32d5 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:04.408228 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73301254-a473-433f-92cc-95c4698d32d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:04.409039 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73301254-a473-433f-92cc-95c4698d32d5 None admin] PATH_INFO: `/v3/services/image` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:04.410691 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73301254-a473-433f-92cc-95c4698d32d5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:04.413752 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73301254-a473-433f-92cc-95c4698d32d5 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:04.438050 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-73301254-a473-433f-92cc-95c4698d32d5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:04:04.438050 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:04.438050 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:04:04.438050 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:04:04.438050 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:04:04.438050 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:04:04.438050 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:04:04.438050 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:04.438050 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:04:04.438050 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:04.438050 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:04:04.438050 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:04.438050 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:04.438050 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:04.438050 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:04.438050 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:04.438050 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:04.439894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:04.439894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:04.439894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:04.439894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:04.439894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:04.439894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:04.439894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:04:04.439894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:04:04.439894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:04:04.439894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:04:04.439894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:04.439894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:04.439894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:04.439894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:04.439894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:04.439894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:04.441411 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:04.441411 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:04:04.441411 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:04.441411 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:04.441411 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:04.441411 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:04.441411 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:04.441411 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:04.441411 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:04.441411 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:04.441411 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:04:04.441411 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:04.441411 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:04:04.441411 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:04.452250 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 354/720] 10.222.0.39 () {56 vars in 1105 bytes} [Wed May 25 15:04:04 2022] GET /identity/v3/services/image => generated 86 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:04:04.459496 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73301254-a473-433f-92cc-95c4698d32d5 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:04.467620 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c8251-9650-42b8-b96c-1d46e1b3ae88 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:04.509394 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42f0c5-4185-4269-8524-5b08e58668ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:04.510577 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42f0c5-4185-4269-8524-5b08e58668ae None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:04.510959 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42f0c5-4185-4269-8524-5b08e58668ae None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:04.511320 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42f0c5-4185-4269-8524-5b08e58668ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:04.523670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42f0c5-4185-4269-8524-5b08e58668ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:04.530107 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42f0c5-4185-4269-8524-5b08e58668ae None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:04.542780 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-ea42f0c5-4185-4269-8524-5b08e58668ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 15:04:04.542780 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:04.542780 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:04.542780 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:04.542780 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:04.542780 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:04.542780 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:04.542780 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:04.542780 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:04.542780 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:04.542780 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:04.542780 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:04.542780 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:04:04.542780 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:04:04.542780 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:04:04.542780 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:04:04.544904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:04.544904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:04.544904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:04:04.544904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:04:04.544904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:04:04.544904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:04:04.544904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:04.544904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:04.544904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:04.544904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:04.544904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:04.544904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:04:04.544904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:04.544904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:04.544904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:04.544904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:04.544904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:04.544904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:04.547044 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:04.547044 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:04.547044 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:04:04.547044 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:04:04.547044 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:04:04.547044 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:04:04.547044 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:04:04.547044 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:04:04.547044 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 15:04:04.547044 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:04.551139 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 367/721] 10.222.0.39 () {56 vars in 1093 bytes} [Wed May 25 15:04:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:04.552884 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42f0c5-4185-4269-8524-5b08e58668ae None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:04.680247 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73301254-a473-433f-92cc-95c4698d32d5 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:04.697971 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:04.726838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42f0c5-4185-4269-8524-5b08e58668ae None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:04.730399 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db50b85-364c-48db-b133-25df714a5ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:04.731944 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db50b85-364c-48db-b133-25df714a5ab7 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:04.732487 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db50b85-364c-48db-b133-25df714a5ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:04.732999 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db50b85-364c-48db-b133-25df714a5ab7 None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:04.734003 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db50b85-364c-48db-b133-25df714a5ab7 None admin] RBAC: Adding query filter params (name=image) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:04.734611 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db50b85-364c-48db-b133-25df714a5ab7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:04.736338 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db50b85-364c-48db-b133-25df714a5ab7 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:04.747636 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 355/722] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:04:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:04.749085 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db50b85-364c-48db-b133-25df714a5ab7 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:04.752618 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:04.790129 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4517cfc-c024-4957-a27a-c80711c6a700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:04.791313 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4517cfc-c024-4957-a27a-c80711c6a700 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:04.791837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4517cfc-c024-4957-a27a-c80711c6a700 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:04.792316 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4517cfc-c024-4957-a27a-c80711c6a700 None admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:04.793382 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4517cfc-c024-4957-a27a-c80711c6a700 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:04.793918 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4517cfc-c024-4957-a27a-c80711c6a700 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:04.795783 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4517cfc-c024-4957-a27a-c80711c6a700 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:04.821683 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 368/723] 10.222.0.39 () {56 vars in 1133 bytes} [Wed May 25 15:04:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:04.829940 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4517cfc-c024-4957-a27a-c80711c6a700 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:04.942950 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4517cfc-c024-4957-a27a-c80711c6a700 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:04.964802 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db50b85-364c-48db-b133-25df714a5ab7 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:04.996283 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56085424-b2d0-4b57-9dcf-3b800cd341f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:04.997032 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56085424-b2d0-4b57-9dcf-3b800cd341f7 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:04.997449 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56085424-b2d0-4b57-9dcf-3b800cd341f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:04.997730 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56085424-b2d0-4b57-9dcf-3b800cd341f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:05.011522 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e879cdb-b42f-4835-b111-14e229a6b58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:05.013045 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e879cdb-b42f-4835-b111-14e229a6b58d None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:05.013523 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e879cdb-b42f-4835-b111-14e229a6b58d None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:05.013979 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e879cdb-b42f-4835-b111-14e229a6b58d None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:05.015344 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e879cdb-b42f-4835-b111-14e229a6b58d None admin] RBAC: Adding query filter params (type=image) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:05.015877 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e879cdb-b42f-4835-b111-14e229a6b58d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:05.016649 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:05.018406 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e879cdb-b42f-4835-b111-14e229a6b58d None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:05.028334 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 356/724] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:04:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:05.030768 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14c810-7191-46b9-aa9e-6c8c8cf67f36 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:05.031272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14c810-7191-46b9-aa9e-6c8c8cf67f36 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:05.031710 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14c810-7191-46b9-aa9e-6c8c8cf67f36 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:05.034293 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 357/725] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:04:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:05.035066 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14c810-7191-46b9-aa9e-6c8c8cf67f36 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:05.098842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56085424-b2d0-4b57-9dcf-3b800cd341f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:05.101406 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56085424-b2d0-4b57-9dcf-3b800cd341f7 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:05.119191 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:05.160769 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14c810-7191-46b9-aa9e-6c8c8cf67f36 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:05.197553 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bad7b-06a8-49f6-af70-7c2ecfba5d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:05.198459 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bad7b-06a8-49f6-af70-7c2ecfba5d09 None admin] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:05.198856 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bad7b-06a8-49f6-af70-7c2ecfba5d09 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:05.199241 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bad7b-06a8-49f6-af70-7c2ecfba5d09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:05.200079 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bad7b-06a8-49f6-af70-7c2ecfba5d09 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:05.201730 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bad7b-06a8-49f6-af70-7c2ecfba5d09 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:05.222905 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 358/726] 10.222.0.39 () {60 vars in 1144 bytes} [Wed May 25 15:04:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:04:05.224564 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478f6a9-e5b7-4685-ab29-cb424eec6181 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:05.224952 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478f6a9-e5b7-4685-ab29-cb424eec6181 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:05.225357 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478f6a9-e5b7-4685-ab29-cb424eec6181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:05.246421 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-6478f6a9-e5b7-4685-ab29-cb424eec6181 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:05.247999 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-6478f6a9-e5b7-4685-ab29-cb424eec6181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:05.321783 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 369/727] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:04:04 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 15:04:05.329332 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56085424-b2d0-4b57-9dcf-3b800cd341f7 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:05.361970 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 359/728] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:04:05 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:04:05.387703 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478f6a9-e5b7-4685-ab29-cb424eec6181 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:05.422911 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:05.469814 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:05.513747 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56085424-b2d0-4b57-9dcf-3b800cd341f7 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:05.565332 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478f6a9-e5b7-4685-ab29-cb424eec6181 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:05.580623 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cab15-aaf0-4779-9c0f-cf102ec19535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:05.581925 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cab15-aaf0-4779-9c0f-cf102ec19535 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:05.582405 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cab15-aaf0-4779-9c0f-cf102ec19535 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:05.582818 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cab15-aaf0-4779-9c0f-cf102ec19535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:05.599738 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cab15-aaf0-4779-9c0f-cf102ec19535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:05.602535 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cab15-aaf0-4779-9c0f-cf102ec19535 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:05.639850 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5b78c-1c13-46f9-bbd6-20768e97ac0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:05.641757 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5b78c-1c13-46f9-bbd6-20768e97ac0d None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:05.642420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-fc5cab15-aaf0-4779-9c0f-cf102ec19535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:05.642420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:05.642420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:05.642420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:05.642420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:05.642420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:05.642420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:05.642420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:05.642420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:05.642420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:05.642420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:05.642420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:05.642420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:04:05.642420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:04:05.642420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:04:05.644116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:04:05.644116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:05.644116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:05.644116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:05.644116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:05.644116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:05.644116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:05.644116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:05.644116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:04:05.644116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:05.644116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:05.644116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:05.644116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:05.644116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:05.644116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:05.644116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:05.644116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:05.646449 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:04:05.646449 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:04:05.646449 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:05.646449 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:05.646449 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 370/729] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:05.647171 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5b78c-1c13-46f9-bbd6-20768e97ac0d None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:05.647621 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5b78c-1c13-46f9-bbd6-20768e97ac0d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:05.648473 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc5b78c-1c13-46f9-bbd6-20768e97ac0d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:05.650616 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cab15-aaf0-4779-9c0f-cf102ec19535 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:05.651030 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc5b78c-1c13-46f9-bbd6-20768e97ac0d None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:05.671703 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-efc5b78c-1c13-46f9-bbd6-20768e97ac0d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:04:05.671703 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:05.671703 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:04:05.671703 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:04:05.671703 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:04:05.671703 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:04:05.671703 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:04:05.671703 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:05.671703 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:04:05.671703 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:05.671703 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:04:05.671703 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:05.671703 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:05.671703 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:05.671703 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:05.671703 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:05.673552 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:05.673552 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:05.673552 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:05.673552 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:05.673552 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:05.673552 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:05.673552 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:05.673552 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:04:05.673552 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:04:05.673552 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:04:05.673552 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:04:05.673552 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:05.673552 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:05.673552 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:05.673552 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:05.673552 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:05.675247 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:05.675247 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:05.675247 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:04:05.675247 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:05.675247 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:05.675247 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:05.675247 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:05.675247 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:05.675247 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:05.675247 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:05.675247 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:05.675247 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:04:05.675247 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:05.675247 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:04:05.675247 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:05.680287 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 360/730] 10.222.0.39 () {56 vars in 1129 bytes} [Wed May 25 15:04:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:04:05.691163 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5b78c-1c13-46f9-bbd6-20768e97ac0d None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:05.843520 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:05.852742 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cab15-aaf0-4779-9c0f-cf102ec19535 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:05.875990 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5b78c-1c13-46f9-bbd6-20768e97ac0d None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:05.899703 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:05.920001 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e9d7a-aaad-4c79-a306-853789373cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:05.921632 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e9d7a-aaad-4c79-a306-853789373cb5 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:05.922525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e9d7a-aaad-4c79-a306-853789373cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:05.923437 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e9d7a-aaad-4c79-a306-853789373cb5 None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:05.925003 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e9d7a-aaad-4c79-a306-853789373cb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:05.925808 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e9d7a-aaad-4c79-a306-853789373cb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:05.928810 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e9d7a-aaad-4c79-a306-853789373cb5 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:05.935688 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fd736-a88f-47a6-ae97-6833c88362c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:05.936747 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fd736-a88f-47a6-ae97-6833c88362c6 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:05.937390 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fd736-a88f-47a6-ae97-6833c88362c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:05.937861 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fd736-a88f-47a6-ae97-6833c88362c6 None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:05.939137 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0fd736-a88f-47a6-ae97-6833c88362c6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:05.939669 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0fd736-a88f-47a6-ae97-6833c88362c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:05.942057 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0fd736-a88f-47a6-ae97-6833c88362c6 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:05.957878 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 361/731] 10.222.0.39 () {56 vars in 1124 bytes} [Wed May 25 15:04:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:04:05.958110 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 371/732] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:05.960027 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fd736-a88f-47a6-ae97-6833c88362c6 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:05.964066 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e9d7a-aaad-4c79-a306-853789373cb5 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:06.069159 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fd736-a88f-47a6-ae97-6833c88362c6 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:06.107233 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118ab5c-15fa-4b66-bcbb-0e761b848c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:06.108390 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118ab5c-15fa-4b66-bcbb-0e761b848c17 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:06.108893 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118ab5c-15fa-4b66-bcbb-0e761b848c17 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:06.109552 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118ab5c-15fa-4b66-bcbb-0e761b848c17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:06.117662 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118ab5c-15fa-4b66-bcbb-0e761b848c17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:06.119544 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2118ab5c-15fa-4b66-bcbb-0e761b848c17 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:06.136245 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-2118ab5c-15fa-4b66-bcbb-0e761b848c17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:04:06.136245 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:06.136245 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:06.136245 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:06.136245 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:06.136245 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:06.136245 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:06.136245 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:06.136245 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:06.136245 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:06.136245 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:06.136245 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:06.136245 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:04:06.136245 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:04:06.136245 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:04:06.137196 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:04:06.137196 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:06.137196 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:06.137196 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:06.137196 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:06.137196 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:06.137196 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:06.137196 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:06.137196 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:04:06.137196 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:06.137196 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:06.137196 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:06.137196 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:06.137196 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:06.137196 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:06.137196 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:06.137196 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:06.138082 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:04:06.138082 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:04:06.138082 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:04:06.138082 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:04:06.138082 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:04:06.138082 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:04:06.138082 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:04:06.138082 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:06.145760 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 362/733] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:04:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:06.147079 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118ab5c-15fa-4b66-bcbb-0e761b848c17 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:06.170422 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e9d7a-aaad-4c79-a306-853789373cb5 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:06.187185 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:06.250175 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef031da-1347-44b3-bc31-f6722979047b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:06.251764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef031da-1347-44b3-bc31-f6722979047b None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:06.252477 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef031da-1347-44b3-bc31-f6722979047b None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:06.253202 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef031da-1347-44b3-bc31-f6722979047b None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:06.255196 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef031da-1347-44b3-bc31-f6722979047b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:06.256059 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef031da-1347-44b3-bc31-f6722979047b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:06.259158 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef031da-1347-44b3-bc31-f6722979047b None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:06.264243 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118ab5c-15fa-4b66-bcbb-0e761b848c17 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:06.278096 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 372/734] 10.222.0.39 () {56 vars in 1124 bytes} [Wed May 25 15:04:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:06.280846 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef031da-1347-44b3-bc31-f6722979047b None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:06.303828 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666e487-fec8-44ca-b348-30c55e483815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:06.304514 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666e487-fec8-44ca-b348-30c55e483815 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:06.304805 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666e487-fec8-44ca-b348-30c55e483815 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:06.305085 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666e487-fec8-44ca-b348-30c55e483815 None admin] PATH_INFO: `/v3/projects` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:06.305885 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666e487-fec8-44ca-b348-30c55e483815 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:06.306530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666e487-fec8-44ca-b348-30c55e483815 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:06.308039 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666e487-fec8-44ca-b348-30c55e483815 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:06.325973 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 363/735] 10.222.0.39 () {56 vars in 1148 bytes} [Wed May 25 15:04:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:06.327124 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666e487-fec8-44ca-b348-30c55e483815 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:06.333656 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:06.425631 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef031da-1347-44b3-bc31-f6722979047b None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:06.429849 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:06.437533 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666e487-fec8-44ca-b348-30c55e483815 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:06.470379 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00352286-84ad-472a-9c9e-d472c0754c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:06.471241 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00352286-84ad-472a-9c9e-d472c0754c60 None admin] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:06.471528 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00352286-84ad-472a-9c9e-d472c0754c60 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:06.471809 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00352286-84ad-472a-9c9e-d472c0754c60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:06.472587 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00352286-84ad-472a-9c9e-d472c0754c60 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:06.473987 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00352286-84ad-472a-9c9e-d472c0754c60 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:06.478196 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f541197-4310-441a-8b36-eb873ab5aee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:06.478895 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f541197-4310-441a-8b36-eb873ab5aee0 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:06.479175 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f541197-4310-441a-8b36-eb873ab5aee0 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:06.479444 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f541197-4310-441a-8b36-eb873ab5aee0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:06.480271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f541197-4310-441a-8b36-eb873ab5aee0 None admin] RBAC: Adding query filter params (role.id=ff521c95c8aa454ea3daa6bc36d055b1, scope.project.id=ff4afc67ebcf4840946ce41755f94bf0, user.id=33f6a22c123f48a09af2f78636a04699) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:06.480580 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f541197-4310-441a-8b36-eb873ab5aee0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:06.482001 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f541197-4310-441a-8b36-eb873ab5aee0 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:06.494272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 364/736] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:04:06 2022] GET /identity/v3/role_assignments?user.id=33f6a22c123f48a09af2f78636a04699&scope.project.id=ff4afc67ebcf4840946ce41755f94bf0&role.id=ff521c95c8aa454ea3daa6bc36d055b1 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:04:06.494272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d68ee-8418-4646-b58d-d079be9d72af None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:06.494272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d68ee-8418-4646-b58d-d079be9d72af None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:06.494272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d68ee-8418-4646-b58d-d079be9d72af None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:06.494272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 365/737] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:06.498596 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac87344-cf2a-444a-a7ee-2c9a9d5baf47 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:06.498878 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac87344-cf2a-444a-a7ee-2c9a9d5baf47 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:06.499147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac87344-cf2a-444a-a7ee-2c9a9d5baf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:06.503552 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 373/738] 10.222.0.39 () {60 vars in 1144 bytes} [Wed May 25 15:04:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:04:06.523345 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-3ac87344-cf2a-444a-a7ee-2c9a9d5baf47 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:06.524687 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-3ac87344-cf2a-444a-a7ee-2c9a9d5baf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:06.620838 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 366/739] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:04:06 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:04:06.663139 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00352286-84ad-472a-9c9e-d472c0754c60 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:06.767627 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:06.792982 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00352286-84ad-472a-9c9e-d472c0754c60 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:06.844926 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7f749-4c1d-4bdc-bc6f-f7394ea01c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:06.845754 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7f749-4c1d-4bdc-bc6f-f7394ea01c7a None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:06.846040 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7f749-4c1d-4bdc-bc6f-f7394ea01c7a None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:06.846358 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7f749-4c1d-4bdc-bc6f-f7394ea01c7a None admin] PATH_INFO: `/v3/services/network` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:06.847126 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7f749-4c1d-4bdc-bc6f-f7394ea01c7a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:06.848520 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7f749-4c1d-4bdc-bc6f-f7394ea01c7a None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:06.871904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-58f7f749-4c1d-4bdc-bc6f-f7394ea01c7a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:04:06.871904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:06.871904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:04:06.871904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:04:06.871904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:04:06.871904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:04:06.871904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:04:06.871904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:06.871904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:04:06.871904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:06.871904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:04:06.871904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:06.871904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:06.871904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:06.871904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:06.871904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:06.871904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:06.873838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:06.873838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:06.873838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:06.873838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:06.873838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:06.873838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:06.873838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:04:06.873838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:04:06.873838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:04:06.873838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:04:06.873838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:06.873838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:06.873838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:06.873838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:06.873838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:06.873838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:06.875746 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:06.875746 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:04:06.875746 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:06.875746 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:06.875746 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:06.875746 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:06.875746 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:06.875746 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:06.875746 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:06.875746 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:06.875746 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:04:06.875746 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:06.875746 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:04:06.875746 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:06.881005 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 374/740] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:04:06 2022] GET /identity/v3/services/network => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:06.888082 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac87344-cf2a-444a-a7ee-2c9a9d5baf47 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:06.981537 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:06.998988 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac87344-cf2a-444a-a7ee-2c9a9d5baf47 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:07.038135 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316b2f3-cb63-4dde-94fb-d1ef28b7114c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:07.038816 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316b2f3-cb63-4dde-94fb-d1ef28b7114c None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:07.039102 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316b2f3-cb63-4dde-94fb-d1ef28b7114c None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:07.039385 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316b2f3-cb63-4dde-94fb-d1ef28b7114c None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:07.040119 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316b2f3-cb63-4dde-94fb-d1ef28b7114c None admin] RBAC: Adding query filter params (name=network) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:07.040429 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316b2f3-cb63-4dde-94fb-d1ef28b7114c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:07.041854 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316b2f3-cb63-4dde-94fb-d1ef28b7114c None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:07.047849 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 367/741] 10.222.0.39 () {56 vars in 1112 bytes} [Wed May 25 15:04:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:07.054064 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7f749-4c1d-4bdc-bc6f-f7394ea01c7a None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:07.172678 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7f749-4c1d-4bdc-bc6f-f7394ea01c7a None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:07.212218 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432548a-c594-40c0-a191-81bf710468e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:07.212941 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432548a-c594-40c0-a191-81bf710468e4 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:07.213219 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432548a-c594-40c0-a191-81bf710468e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:07.213497 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432548a-c594-40c0-a191-81bf710468e4 None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:07.214198 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432548a-c594-40c0-a191-81bf710468e4 None admin] RBAC: Adding query filter params (type=network) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:07.214579 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432548a-c594-40c0-a191-81bf710468e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:07.215977 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432548a-c594-40c0-a191-81bf710468e4 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:07.222491 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 375/742] 10.222.0.39 () {56 vars in 1112 bytes} [Wed May 25 15:04:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:07.227749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316b2f3-cb63-4dde-94fb-d1ef28b7114c None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:07.365609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316b2f3-cb63-4dde-94fb-d1ef28b7114c None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:07.430218 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd34853-5ad2-47ee-bc98-dabcf5f708d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:07.431942 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd34853-5ad2-47ee-bc98-dabcf5f708d9 None admin] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:07.432586 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd34853-5ad2-47ee-bc98-dabcf5f708d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:07.433214 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd34853-5ad2-47ee-bc98-dabcf5f708d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:07.434763 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd34853-5ad2-47ee-bc98-dabcf5f708d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:07.437486 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd34853-5ad2-47ee-bc98-dabcf5f708d9 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:07.473867 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 368/743] 10.222.0.39 () {60 vars in 1144 bytes} [Wed May 25 15:04:07 2022] POST /identity/v3/endpoints => generated 327 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:04:07.769728 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca0d3b-5662-4162-8314-d129eed4e745 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:07.770078 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca0d3b-5662-4162-8314-d129eed4e745 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:07.770282 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca0d3b-5662-4162-8314-d129eed4e745 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:07.771808 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 376/744] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:07.777428 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c43fd3-87f3-472a-b21f-1f85d5129b33 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:07.777791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c43fd3-87f3-472a-b21f-1f85d5129b33 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:07.778002 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c43fd3-87f3-472a-b21f-1f85d5129b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:07.791043 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:07.797887 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-78c43fd3-87f3-472a-b21f-1f85d5129b33 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:07.799701 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-78c43fd3-87f3-472a-b21f-1f85d5129b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:07.886570 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 369/745] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:04:07 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:04:07.910486 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca0d3b-5662-4162-8314-d129eed4e745 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:07.920861 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:08.060592 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca0d3b-5662-4162-8314-d129eed4e745 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:08.101311 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b32280-1f63-4f4e-9494-705b0b262871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:08.101962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b32280-1f63-4f4e-9494-705b0b262871 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:08.102278 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b32280-1f63-4f4e-9494-705b0b262871 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:08.102586 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b32280-1f63-4f4e-9494-705b0b262871 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:08.175434 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b32280-1f63-4f4e-9494-705b0b262871 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:08.176904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b32280-1f63-4f4e-9494-705b0b262871 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:08.187565 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:08.308409 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 377/746] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:04:07 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:04:08.315660 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c43fd3-87f3-472a-b21f-1f85d5129b33 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:08.437068 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c43fd3-87f3-472a-b21f-1f85d5129b33 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:08.492045 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:08.500198 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4677ae3c-676d-45b7-883d-45447087c4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:08.501164 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677ae3c-676d-45b7-883d-45447087c4f7 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:08.501449 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677ae3c-676d-45b7-883d-45447087c4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:08.501751 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4677ae3c-676d-45b7-883d-45447087c4f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:08.513917 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677ae3c-676d-45b7-883d-45447087c4f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:08.515814 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4677ae3c-676d-45b7-883d-45447087c4f7 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:08.537777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-4677ae3c-676d-45b7-883d-45447087c4f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:08.537777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:08.537777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:08.537777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:08.537777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:08.537777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:08.537777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:08.537777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:08.537777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:08.537777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:08.537777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:08.537777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:08.537777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:04:08.537777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:04:08.537777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:04:08.539728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:04:08.539728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:08.539728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:08.539728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:08.539728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:08.539728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:08.539728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:08.539728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:08.539728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:04:08.539728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:08.539728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:08.539728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:08.539728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:08.539728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:08.539728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:08.539728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:08.539728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:08.541309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:04:08.541309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:04:08.541309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:04:08.541309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:08.545938 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 370/747] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:04:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:04:08.547823 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b32280-1f63-4f4e-9494-705b0b262871 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:08.711311 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b32280-1f63-4f4e-9494-705b0b262871 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:08.720893 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:08.755380 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc1fbd-4208-4289-b178-7247cb28595a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:08.756236 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc1fbd-4208-4289-b178-7247cb28595a None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:08.756653 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc1fbd-4208-4289-b178-7247cb28595a None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:08.757054 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc1fbd-4208-4289-b178-7247cb28595a None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:08.757962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc1fbd-4208-4289-b178-7247cb28595a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:08.758448 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc1fbd-4208-4289-b178-7247cb28595a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:08.759988 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc1fbd-4208-4289-b178-7247cb28595a None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:08.774512 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 378/748] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:09.117614 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6f14b-1bf9-4f16-b3ed-750af18334d4 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:09.118017 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6f14b-1bf9-4f16-b3ed-750af18334d4 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:09.118156 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6f14b-1bf9-4f16-b3ed-750af18334d4 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:09.119906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 371/749] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:09.127265 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9993b-98a7-4798-b2d1-32155ba918c4 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:09.128101 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9993b-98a7-4798-b2d1-32155ba918c4 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:09.128265 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9993b-98a7-4798-b2d1-32155ba918c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:09.149901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-31c9993b-98a7-4798-b2d1-32155ba918c4 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:09.151560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-31c9993b-98a7-4798-b2d1-32155ba918c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:09.164951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5653406-7c26-41f4-b41a-4da8c3cff22f None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:09.165318 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5653406-7c26-41f4-b41a-4da8c3cff22f None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:09.165655 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5653406-7c26-41f4-b41a-4da8c3cff22f None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:09.167264 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 372/750] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:04:09.173565 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a5f86-27cd-4d09-9ebd-a6aa38af2b40 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:09.173864 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a5f86-27cd-4d09-9ebd-a6aa38af2b40 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:09.174148 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a5f86-27cd-4d09-9ebd-a6aa38af2b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:09.191775 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-b01a5f86-27cd-4d09-9ebd-a6aa38af2b40 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:09.193002 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-b01a5f86-27cd-4d09-9ebd-a6aa38af2b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:09.229592 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 379/751] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:04:09 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:04:09.254292 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9993b-98a7-4798-b2d1-32155ba918c4 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:09.271518 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 373/752] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:04:09 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:04:09.294894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a5f86-27cd-4d09-9ebd-a6aa38af2b40 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:09.358941 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:09.367119 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9993b-98a7-4798-b2d1-32155ba918c4 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:09.412097 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a5f86-27cd-4d09-9ebd-a6aa38af2b40 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:09.412657 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c120a-ceed-423f-abee-4cf2cd9ec8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:09.412949 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c120a-ceed-423f-abee-4cf2cd9ec8eb None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:09.413237 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c120a-ceed-423f-abee-4cf2cd9ec8eb None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:09.413522 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c120a-ceed-423f-abee-4cf2cd9ec8eb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:09.414193 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c120a-ceed-423f-abee-4cf2cd9ec8eb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:09.415682 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c120a-ceed-423f-abee-4cf2cd9ec8eb None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:09.428702 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:09.428951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-217c120a-ceed-423f-abee-4cf2cd9ec8eb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:04:09.428951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:09.428951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:04:09.428951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:04:09.428951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:04:09.428951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:04:09.428951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:04:09.428951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:09.428951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:04:09.428951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:09.428951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:04:09.428951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:09.428951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:09.428951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:09.428951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:09.428951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:09.428951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:09.429976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:09.429976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:09.429976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:09.429976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:09.429976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:09.429976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:09.429976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:04:09.429976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:04:09.429976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:04:09.429976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:04:09.429976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:09.429976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:09.429976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:09.429976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:09.429976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:09.429976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:09.430991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:09.430991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:04:09.430991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:09.430991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:09.430991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:09.430991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:09.430991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:09.430991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:09.430991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:09.430991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:09.430991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:04:09.430991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:09.430991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:04:09.430991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:09.430991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 380/753] 10.222.0.39 () {56 vars in 1114 bytes} [Wed May 25 15:04:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:04:09.440350 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c120a-ceed-423f-abee-4cf2cd9ec8eb None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:09.459147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e198c8-60c2-473f-83a3-f81cff9f249e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:09.460018 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e198c8-60c2-473f-83a3-f81cff9f249e None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:09.460300 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e198c8-60c2-473f-83a3-f81cff9f249e None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:09.460576 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e198c8-60c2-473f-83a3-f81cff9f249e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:09.461245 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e198c8-60c2-473f-83a3-f81cff9f249e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:09.462703 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e198c8-60c2-473f-83a3-f81cff9f249e None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:09.476331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-42e198c8-60c2-473f-83a3-f81cff9f249e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:04:09.476331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:09.476331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:04:09.476331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:04:09.476331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:04:09.476331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:04:09.476331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:04:09.476331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:09.476331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:04:09.476331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:09.476331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:04:09.476331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:09.476331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:09.476331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:09.476331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:09.476331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:09.485057 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:09.485057 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:09.485057 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:09.485057 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:09.485057 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:09.485057 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:09.485057 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:09.485057 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:04:09.485057 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:04:09.485057 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:04:09.485057 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:04:09.485057 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:09.485057 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:09.485057 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:09.485057 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:09.485057 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:09.485912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:09.485912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:09.485912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:04:09.485912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:09.485912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:09.485912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:09.485912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:09.485912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:09.485912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:09.485912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:09.485912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:09.485912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:04:09.485912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:09.485912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:04:09.485912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:09.485912 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 374/754] 10.222.0.39 () {56 vars in 1132 bytes} [Wed May 25 15:04:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:04:09.486783 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e198c8-60c2-473f-83a3-f81cff9f249e None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:09.550418 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c120a-ceed-423f-abee-4cf2cd9ec8eb None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:09.586543 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac3c69-4dec-4d56-9e6f-61cac183a05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:09.587228 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac3c69-4dec-4d56-9e6f-61cac183a05b None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:09.587506 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac3c69-4dec-4d56-9e6f-61cac183a05b None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:09.587776 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac3c69-4dec-4d56-9e6f-61cac183a05b None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:09.588484 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac3c69-4dec-4d56-9e6f-61cac183a05b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:09.588780 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac3c69-4dec-4d56-9e6f-61cac183a05b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:09.590185 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac3c69-4dec-4d56-9e6f-61cac183a05b None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:09.595454 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 381/755] 10.222.0.39 () {56 vars in 1114 bytes} [Wed May 25 15:04:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:04:09.598895 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e198c8-60c2-473f-83a3-f81cff9f249e None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:09.601109 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac3c69-4dec-4d56-9e6f-61cac183a05b None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:09.627512 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:09.635791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e154a3-8659-42d2-84bb-5b9212bd373c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:09.636476 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e154a3-8659-42d2-84bb-5b9212bd373c None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:09.636764 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e154a3-8659-42d2-84bb-5b9212bd373c None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:09.637045 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e154a3-8659-42d2-84bb-5b9212bd373c None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:09.637761 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e154a3-8659-42d2-84bb-5b9212bd373c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:09.638075 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e154a3-8659-42d2-84bb-5b9212bd373c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:09.639517 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e154a3-8659-42d2-84bb-5b9212bd373c None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:09.644598 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 375/756] 10.222.0.39 () {56 vars in 1126 bytes} [Wed May 25 15:04:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:04:09.650347 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e154a3-8659-42d2-84bb-5b9212bd373c None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:09.699017 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:09.709638 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac3c69-4dec-4d56-9e6f-61cac183a05b None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:09.748617 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755177c-0771-4d27-b752-c256c9685d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:09.749426 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755177c-0771-4d27-b752-c256c9685d6a None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:09.749766 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755177c-0771-4d27-b752-c256c9685d6a None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:09.750183 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755177c-0771-4d27-b752-c256c9685d6a None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:09.751034 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755177c-0771-4d27-b752-c256c9685d6a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:09.751433 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755177c-0771-4d27-b752-c256c9685d6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:09.752934 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755177c-0771-4d27-b752-c256c9685d6a None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:09.758282 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 382/757] 10.222.0.39 () {56 vars in 1114 bytes} [Wed May 25 15:04:09 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:04:09.764574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e154a3-8659-42d2-84bb-5b9212bd373c None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:09.808581 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9de859-cb9c-4402-97fe-b7f95bf748f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:09.809298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9de859-cb9c-4402-97fe-b7f95bf748f9 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:09.809565 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9de859-cb9c-4402-97fe-b7f95bf748f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:09.809942 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9de859-cb9c-4402-97fe-b7f95bf748f9 None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:09.810757 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9de859-cb9c-4402-97fe-b7f95bf748f9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:09.822849 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9de859-cb9c-4402-97fe-b7f95bf748f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:09.822849 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9de859-cb9c-4402-97fe-b7f95bf748f9 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:09.822849 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 376/758] 10.222.0.39 () {56 vars in 1126 bytes} [Wed May 25 15:04:09 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:04:12.098442 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bf860-c73b-4aeb-89f8-9f55493e79fd None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:12.099051 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bf860-c73b-4aeb-89f8-9f55493e79fd None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:12.099051 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bf860-c73b-4aeb-89f8-9f55493e79fd None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:12.100321 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 383/759] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:12.105922 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5070fa-20db-4c5e-8703-eb73d32071d5 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:12.106423 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5070fa-20db-4c5e-8703-eb73d32071d5 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:12.106523 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5070fa-20db-4c5e-8703-eb73d32071d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:12.115323 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43b9ad-2183-49ef-abd8-d04d71d3162b None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:12.115588 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43b9ad-2183-49ef-abd8-d04d71d3162b None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:12.115896 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43b9ad-2183-49ef-abd8-d04d71d3162b None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:12.117229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 384/760] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:04:12.122390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d886b5-8d61-41f2-a29a-e1fea6e59baf None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:12.122679 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d886b5-8d61-41f2-a29a-e1fea6e59baf None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:12.122953 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d886b5-8d61-41f2-a29a-e1fea6e59baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:12.124870 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-fa5070fa-20db-4c5e-8703-eb73d32071d5 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:12.126100 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-fa5070fa-20db-4c5e-8703-eb73d32071d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:12.141201 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-a6d886b5-8d61-41f2-a29a-e1fea6e59baf None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:12.142489 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-a6d886b5-8d61-41f2-a29a-e1fea6e59baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:12.199733 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 377/761] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:04:12 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:04:12.212740 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 385/762] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:04:12 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:04:12.223872 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5070fa-20db-4c5e-8703-eb73d32071d5 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:12.236484 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d886b5-8d61-41f2-a29a-e1fea6e59baf None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:12.254968 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:12.260093 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:12.326763 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5070fa-20db-4c5e-8703-eb73d32071d5 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:12.336280 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d886b5-8d61-41f2-a29a-e1fea6e59baf None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:12.362510 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4586c-4079-4864-ad94-046ec75b7656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:12.363110 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4586c-4079-4864-ad94-046ec75b7656 None admin] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:12.363396 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4586c-4079-4864-ad94-046ec75b7656 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:12.363673 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4586c-4079-4864-ad94-046ec75b7656 None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:12.364398 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4586c-4079-4864-ad94-046ec75b7656 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:12.365782 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4586c-4079-4864-ad94-046ec75b7656 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:12.371684 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36d5c2-cb3e-4bf1-a723-74e4021f0d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:12.372432 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36d5c2-cb3e-4bf1-a723-74e4021f0d8e None admin] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:12.372787 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36d5c2-cb3e-4bf1-a723-74e4021f0d8e None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:12.373133 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36d5c2-cb3e-4bf1-a723-74e4021f0d8e None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:12.374024 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36d5c2-cb3e-4bf1-a723-74e4021f0d8e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:12.375592 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36d5c2-cb3e-4bf1-a723-74e4021f0d8e None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:12.380024 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 378/763] 10.222.0.39 () {60 vars in 1141 bytes} [Wed May 25 15:04:12 2022] POST /identity/v3/services => generated 269 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:04:12.392589 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 386/764] 10.222.0.39 () {60 vars in 1141 bytes} [Wed May 25 15:04:12 2022] POST /identity/v3/services => generated 251 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:04:14.684297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a5425-7aa1-4e5a-937c-1c761db89f79 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:14.684846 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a5425-7aa1-4e5a-937c-1c761db89f79 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:14.684846 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a5425-7aa1-4e5a-937c-1c761db89f79 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:14.686186 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 379/765] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:04:14.691867 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa543979-ed4a-4a6c-aef1-999838710c12 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:14.692328 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa543979-ed4a-4a6c-aef1-999838710c12 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:14.692536 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa543979-ed4a-4a6c-aef1-999838710c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:14.710448 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-fa543979-ed4a-4a6c-aef1-999838710c12 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:14.711580 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-fa543979-ed4a-4a6c-aef1-999838710c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:14.763633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21b98f-8dfb-42ef-976c-3876094ece14 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:14.764244 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21b98f-8dfb-42ef-976c-3876094ece14 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:14.764557 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21b98f-8dfb-42ef-976c-3876094ece14 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:14.767095 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 380/766] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:04:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:14.773178 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1a21e-44ed-4615-b3e6-0e44f6217255 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:14.773530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1a21e-44ed-4615-b3e6-0e44f6217255 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:14.773859 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1a21e-44ed-4615-b3e6-0e44f6217255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:14.792368 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-f4d1a21e-44ed-4615-b3e6-0e44f6217255 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:14.793556 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-f4d1a21e-44ed-4615-b3e6-0e44f6217255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:14.795882 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 387/767] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:04:14 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:04:14.819605 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa543979-ed4a-4a6c-aef1-999838710c12 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:14.822738 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:14.864588 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 381/768] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:04:14 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:04:14.888494 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1a21e-44ed-4615-b3e6-0e44f6217255 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:14.916739 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:14.925573 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa543979-ed4a-4a6c-aef1-999838710c12 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:14.959525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621b692-733e-4421-93cd-47de05acb6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:14.960331 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621b692-733e-4421-93cd-47de05acb6e0 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:14.960661 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621b692-733e-4421-93cd-47de05acb6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:14.960882 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621b692-733e-4421-93cd-47de05acb6e0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:14.961531 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621b692-733e-4421-93cd-47de05acb6e0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:14.962934 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621b692-733e-4421-93cd-47de05acb6e0 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:14.974946 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-d621b692-733e-4421-93cd-47de05acb6e0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:04:14.974946 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:14.974946 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:04:14.974946 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:04:14.974946 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:04:14.974946 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:04:14.974946 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:04:14.974946 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:14.974946 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:04:14.974946 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:14.974946 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:04:14.974946 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:14.974946 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:14.974946 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:14.974946 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:14.974946 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:14.974946 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:14.975992 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:14.975992 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:14.975992 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:14.975992 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:14.975992 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:14.975992 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:14.975992 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:04:14.975992 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:04:14.975992 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:04:14.975992 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:04:14.975992 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:14.975992 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:14.975992 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:14.975992 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:14.975992 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:14.975992 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:14.976831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:14.976831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:04:14.976831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:14.976831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:14.976831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:14.976831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:14.976831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:14.976831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:14.976831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:14.976831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:14.976831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:04:14.976831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:14.976831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:04:14.976831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:14.976831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 388/769] 10.222.0.39 () {56 vars in 1114 bytes} [Wed May 25 15:04:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:14.983570 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621b692-733e-4421-93cd-47de05acb6e0 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:14.994900 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1a21e-44ed-4615-b3e6-0e44f6217255 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:15.029452 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c90feb-9198-4967-92e6-2c3f42aadf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:15.030296 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c90feb-9198-4967-92e6-2c3f42aadf3b None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:15.030981 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c90feb-9198-4967-92e6-2c3f42aadf3b None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:15.031246 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c90feb-9198-4967-92e6-2c3f42aadf3b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:15.031904 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c90feb-9198-4967-92e6-2c3f42aadf3b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:15.033275 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c90feb-9198-4967-92e6-2c3f42aadf3b None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:15.045582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-92c90feb-9198-4967-92e6-2c3f42aadf3b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:04:15.045582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:15.045582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:04:15.045582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:04:15.045582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:04:15.045582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:04:15.045582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:04:15.045582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:15.045582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:04:15.045582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:15.045582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:04:15.045582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:15.045582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:15.045582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:15.045582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:15.045582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:15.046726 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:15.046726 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:15.046726 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:15.046726 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:15.046726 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:15.046726 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:15.046726 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:15.046726 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:04:15.046726 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:04:15.046726 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:04:15.046726 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:04:15.046726 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:15.046726 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:15.046726 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:15.046726 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:15.046726 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:15.047558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:15.047558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:15.047558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:04:15.047558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:15.047558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:15.047558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:15.047558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:15.047558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:15.047558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:15.047558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:15.047558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:15.047558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:04:15.047558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:15.047558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:04:15.047558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:15.047558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 382/770] 10.222.0.39 () {56 vars in 1132 bytes} [Wed May 25 15:04:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:15.054535 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:15.055157 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c90feb-9198-4967-92e6-2c3f42aadf3b None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:15.091263 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621b692-733e-4421-93cd-47de05acb6e0 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:15.124814 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427bd57-50b1-4be7-9158-cc0e7d7f9fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:15.125615 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427bd57-50b1-4be7-9158-cc0e7d7f9fc7 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:15.125901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427bd57-50b1-4be7-9158-cc0e7d7f9fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:15.126176 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427bd57-50b1-4be7-9158-cc0e7d7f9fc7 None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:15.126916 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427bd57-50b1-4be7-9158-cc0e7d7f9fc7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:15.127223 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427bd57-50b1-4be7-9158-cc0e7d7f9fc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:15.128611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427bd57-50b1-4be7-9158-cc0e7d7f9fc7 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:15.133371 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 389/771] 10.222.0.39 () {56 vars in 1114 bytes} [Wed May 25 15:04:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:04:15.139031 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427bd57-50b1-4be7-9158-cc0e7d7f9fc7 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:15.149052 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:15.160121 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c90feb-9198-4967-92e6-2c3f42aadf3b None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:15.196173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06e25b-0565-4c47-8c31-ce9d0b815cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:15.196850 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06e25b-0565-4c47-8c31-ce9d0b815cdb None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:15.197131 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06e25b-0565-4c47-8c31-ce9d0b815cdb None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:15.197410 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06e25b-0565-4c47-8c31-ce9d0b815cdb None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:15.198115 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06e25b-0565-4c47-8c31-ce9d0b815cdb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:15.198446 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06e25b-0565-4c47-8c31-ce9d0b815cdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:15.199818 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06e25b-0565-4c47-8c31-ce9d0b815cdb None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:15.204786 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 383/772] 10.222.0.39 () {56 vars in 1126 bytes} [Wed May 25 15:04:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:04:15.210487 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06e25b-0565-4c47-8c31-ce9d0b815cdb None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:15.245649 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427bd57-50b1-4be7-9158-cc0e7d7f9fc7 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:15.276225 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:15.282547 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f8d8c-200d-415f-b9c2-9281877ad4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:15.283213 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f8d8c-200d-415f-b9c2-9281877ad4d5 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:15.283494 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f8d8c-200d-415f-b9c2-9281877ad4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:15.283767 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f8d8c-200d-415f-b9c2-9281877ad4d5 None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:15.284593 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f8d8c-200d-415f-b9c2-9281877ad4d5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:15.284903 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f8d8c-200d-415f-b9c2-9281877ad4d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:15.286325 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f8d8c-200d-415f-b9c2-9281877ad4d5 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:15.291334 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 390/773] 10.222.0.39 () {56 vars in 1114 bytes} [Wed May 25 15:04:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:04:15.297772 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f8d8c-200d-415f-b9c2-9281877ad4d5 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:15.314213 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06e25b-0565-4c47-8c31-ce9d0b815cdb None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:15.348743 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce540a58-6826-4401-9d66-b0d0cda69cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:15.349418 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce540a58-6826-4401-9d66-b0d0cda69cab None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:15.349705 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce540a58-6826-4401-9d66-b0d0cda69cab None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:15.349987 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce540a58-6826-4401-9d66-b0d0cda69cab None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:15.350733 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce540a58-6826-4401-9d66-b0d0cda69cab None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:15.351042 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce540a58-6826-4401-9d66-b0d0cda69cab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:15.352425 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce540a58-6826-4401-9d66-b0d0cda69cab None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:15.357589 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 384/774] 10.222.0.39 () {56 vars in 1126 bytes} [Wed May 25 15:04:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:15.364024 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce540a58-6826-4401-9d66-b0d0cda69cab None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:15.383799 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:15.401425 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f8d8c-200d-415f-b9c2-9281877ad4d5 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:15.437446 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b556835-b0e3-48f7-a7bc-4ae86c6683ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:15.438110 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b556835-b0e3-48f7-a7bc-4ae86c6683ac None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:15.438424 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b556835-b0e3-48f7-a7bc-4ae86c6683ac None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:15.438703 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b556835-b0e3-48f7-a7bc-4ae86c6683ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:15.439543 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b556835-b0e3-48f7-a7bc-4ae86c6683ac None admin] RBAC: Adding query filter params (interface=public, service_id=d7314d7bfe7744da8015b285254b23ad, region_id=RegionOne) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:15.439855 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b556835-b0e3-48f7-a7bc-4ae86c6683ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:15.441228 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b556835-b0e3-48f7-a7bc-4ae86c6683ac None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:15.449278 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 391/775] 10.222.0.39 () {56 vars in 1251 bytes} [Wed May 25 15:04:15 2022] GET /identity/v3/endpoints?service_id=d7314d7bfe7744da8015b285254b23ad&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:04:15.455069 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b556835-b0e3-48f7-a7bc-4ae86c6683ac None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:15.475550 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce540a58-6826-4401-9d66-b0d0cda69cab None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:15.520977 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9454d5b-42b0-4774-a23c-442e47e8300e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:15.522017 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9454d5b-42b0-4774-a23c-442e47e8300e None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:15.522561 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9454d5b-42b0-4774-a23c-442e47e8300e None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:15.523016 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9454d5b-42b0-4774-a23c-442e47e8300e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:15.524493 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9454d5b-42b0-4774-a23c-442e47e8300e None admin] RBAC: Adding query filter params (interface=public, service_id=d199d903c98648f194f20d4bdbbd7112, region_id=RegionOne) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:15.525064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9454d5b-42b0-4774-a23c-442e47e8300e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:15.526738 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9454d5b-42b0-4774-a23c-442e47e8300e None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:15.532289 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:15.535588 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 385/776] 10.222.0.39 () {56 vars in 1251 bytes} [Wed May 25 15:04:15 2022] GET /identity/v3/endpoints?service_id=d199d903c98648f194f20d4bdbbd7112&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:04:15.541060 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9454d5b-42b0-4774-a23c-442e47e8300e None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:15.580380 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b556835-b0e3-48f7-a7bc-4ae86c6683ac None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:15.617812 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3940a9-1948-43b9-b33e-172cb4aecaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:15.618525 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3940a9-1948-43b9-b33e-172cb4aecaa1 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:15.618806 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3940a9-1948-43b9-b33e-172cb4aecaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:15.619080 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3940a9-1948-43b9-b33e-172cb4aecaa1 None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:15.619766 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3940a9-1948-43b9-b33e-172cb4aecaa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:15.621131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3940a9-1948-43b9-b33e-172cb4aecaa1 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:15.629066 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 392/777] 10.222.0.39 () {56 vars in 1087 bytes} [Wed May 25 15:04:15 2022] GET /identity/v3/services => generated 1498 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:04:15.638782 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:15.660801 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9454d5b-42b0-4774-a23c-442e47e8300e None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:15.699394 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96dd46-d731-4cf2-8e18-5b8af9e65ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:15.700121 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96dd46-d731-4cf2-8e18-5b8af9e65ce9 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:15.700372 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96dd46-d731-4cf2-8e18-5b8af9e65ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:15.700629 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96dd46-d731-4cf2-8e18-5b8af9e65ce9 None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:15.701363 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96dd46-d731-4cf2-8e18-5b8af9e65ce9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:15.702894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96dd46-d731-4cf2-8e18-5b8af9e65ce9 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:15.709913 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 386/778] 10.222.0.39 () {56 vars in 1087 bytes} [Wed May 25 15:04:15 2022] GET /identity/v3/services => generated 1498 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:04:18.013141 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a556efa-95ca-484a-82a2-db583b2d4b62 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:18.013664 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a556efa-95ca-484a-82a2-db583b2d4b62 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:18.013664 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a556efa-95ca-484a-82a2-db583b2d4b62 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:18.015229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 393/779] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:18.020619 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143a1de-0fec-4668-ac6e-73213258d511 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:18.021094 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143a1de-0fec-4668-ac6e-73213258d511 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:18.021195 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143a1de-0fec-4668-ac6e-73213258d511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:18.031770 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef4f09-0d51-4ba2-b194-634cc4175e05 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:18.032060 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef4f09-0d51-4ba2-b194-634cc4175e05 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:18.032342 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef4f09-0d51-4ba2-b194-634cc4175e05 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:18.033735 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 394/780] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:18.038985 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b7caa-cef0-487b-92c5-c49a91895add None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:18.039276 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b7caa-cef0-487b-92c5-c49a91895add None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:18.039547 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b7caa-cef0-487b-92c5-c49a91895add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:18.039679 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-2143a1de-0fec-4668-ac6e-73213258d511 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:18.040809 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-2143a1de-0fec-4668-ac6e-73213258d511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:18.056829 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-1c4b7caa-cef0-487b-92c5-c49a91895add None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:18.058129 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-1c4b7caa-cef0-487b-92c5-c49a91895add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:18.110582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 387/781] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:04:18 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:04:18.125278 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 395/782] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:04:18 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:04:18.134841 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143a1de-0fec-4668-ac6e-73213258d511 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:18.149532 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b7caa-cef0-487b-92c5-c49a91895add None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:18.208138 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:18.214128 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:18.238366 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143a1de-0fec-4668-ac6e-73213258d511 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:18.254576 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b7caa-cef0-487b-92c5-c49a91895add None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:18.275221 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849cf6a-8e64-44b8-94fe-1016fb4898e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:18.275957 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849cf6a-8e64-44b8-94fe-1016fb4898e1 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:18.276241 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849cf6a-8e64-44b8-94fe-1016fb4898e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:18.276520 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849cf6a-8e64-44b8-94fe-1016fb4898e1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:18.277149 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849cf6a-8e64-44b8-94fe-1016fb4898e1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:18.278560 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849cf6a-8e64-44b8-94fe-1016fb4898e1 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:18.288552 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648074fe-33d2-4545-821b-5eceff92b589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:18.289400 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648074fe-33d2-4545-821b-5eceff92b589 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:18.289662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648074fe-33d2-4545-821b-5eceff92b589 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:18.289939 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648074fe-33d2-4545-821b-5eceff92b589 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:18.290628 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648074fe-33d2-4545-821b-5eceff92b589 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:18.291271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-f849cf6a-8e64-44b8-94fe-1016fb4898e1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:04:18.291271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:18.291271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:04:18.291271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:04:18.291271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:04:18.291271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:04:18.291271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:04:18.291271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:18.291271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:04:18.291271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:18.291271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:04:18.291271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:18.291271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:18.291271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:18.291271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:18.291271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:18.291271 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:18.292473 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:18.292473 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:18.292473 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:18.292473 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:18.292473 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:18.292473 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:18.292473 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:04:18.292473 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:04:18.292473 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:04:18.292473 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:04:18.292473 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:18.292473 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:18.292473 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:18.292473 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:18.292473 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:18.292473 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:18.293298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:18.293298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:04:18.293298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:18.293298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:18.293298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:18.293298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:18.293298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:18.293298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:18.293298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:18.293298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:18.293298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:04:18.293298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:18.293298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:04:18.293298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:18.294019 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648074fe-33d2-4545-821b-5eceff92b589 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:18.294089 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 388/783] 10.222.0.39 () {56 vars in 1114 bytes} [Wed May 25 15:04:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:18.300086 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849cf6a-8e64-44b8-94fe-1016fb4898e1 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:18.311362 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-648074fe-33d2-4545-821b-5eceff92b589 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:04:18.311362 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:18.311362 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:04:18.311362 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:04:18.311362 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:04:18.311362 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:04:18.311362 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:04:18.311362 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:18.311362 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:04:18.311362 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:18.311362 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:04:18.311362 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:18.311362 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:18.311362 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:18.311362 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:18.311362 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:18.312662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:18.312662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:18.312662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:18.312662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:18.312662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:18.312662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:18.312662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:18.312662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:04:18.312662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:04:18.312662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:04:18.312662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:04:18.312662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:18.312662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:18.312662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:18.312662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:18.312662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:18.315357 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:18.315357 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:18.315357 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:04:18.315357 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:18.315357 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:18.315357 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:18.315357 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:18.315357 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:18.315357 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:18.315357 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:18.315357 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:18.315357 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:04:18.315357 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:18.315357 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:04:18.315357 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:18.315357 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 396/784] 10.222.0.39 () {56 vars in 1132 bytes} [Wed May 25 15:04:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:18.320078 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648074fe-33d2-4545-821b-5eceff92b589 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:18.407462 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849cf6a-8e64-44b8-94fe-1016fb4898e1 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:18.427463 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648074fe-33d2-4545-821b-5eceff92b589 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:18.443997 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33087dd9-a214-49ea-96f0-eac06b02c8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:18.444676 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33087dd9-a214-49ea-96f0-eac06b02c8c9 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:18.444959 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33087dd9-a214-49ea-96f0-eac06b02c8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:18.445241 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33087dd9-a214-49ea-96f0-eac06b02c8c9 None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:18.445769 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:18.445920 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33087dd9-a214-49ea-96f0-eac06b02c8c9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:18.446229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33087dd9-a214-49ea-96f0-eac06b02c8c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:18.447660 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33087dd9-a214-49ea-96f0-eac06b02c8c9 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:18.456018 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 389/785] 10.222.0.39 () {56 vars in 1114 bytes} [Wed May 25 15:04:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:18.462030 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33087dd9-a214-49ea-96f0-eac06b02c8c9 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:18.467160 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:18.467334 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6683fc-9949-4eac-8a0d-3283b2e1b094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:18.468553 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6683fc-9949-4eac-8a0d-3283b2e1b094 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:18.469017 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6683fc-9949-4eac-8a0d-3283b2e1b094 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:18.469306 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6683fc-9949-4eac-8a0d-3283b2e1b094 None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:18.470055 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6683fc-9949-4eac-8a0d-3283b2e1b094 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:18.470401 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6683fc-9949-4eac-8a0d-3283b2e1b094 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:18.471823 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6683fc-9949-4eac-8a0d-3283b2e1b094 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:18.477111 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 397/786] 10.222.0.39 () {56 vars in 1126 bytes} [Wed May 25 15:04:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:04:18.485783 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6683fc-9949-4eac-8a0d-3283b2e1b094 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:18.566169 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33087dd9-a214-49ea-96f0-eac06b02c8c9 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:18.590907 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6683fc-9949-4eac-8a0d-3283b2e1b094 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:18.603618 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd95f19-4a52-4e2d-ae5b-45104868c525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:18.604479 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd95f19-4a52-4e2d-ae5b-45104868c525 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:18.604828 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd95f19-4a52-4e2d-ae5b-45104868c525 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:18.605189 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd95f19-4a52-4e2d-ae5b-45104868c525 None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:18.606149 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd95f19-4a52-4e2d-ae5b-45104868c525 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:18.606539 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd95f19-4a52-4e2d-ae5b-45104868c525 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:18.608226 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd95f19-4a52-4e2d-ae5b-45104868c525 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:18.613592 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 390/787] 10.222.0.39 () {56 vars in 1114 bytes} [Wed May 25 15:04:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:18.619500 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd95f19-4a52-4e2d-ae5b-45104868c525 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:18.640741 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c027d05-4a1a-4616-8370-51ea1bf0c07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:18.641510 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c027d05-4a1a-4616-8370-51ea1bf0c07b None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:18.641796 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c027d05-4a1a-4616-8370-51ea1bf0c07b None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:18.642521 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c027d05-4a1a-4616-8370-51ea1bf0c07b None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:18.642820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c027d05-4a1a-4616-8370-51ea1bf0c07b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:18.643127 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c027d05-4a1a-4616-8370-51ea1bf0c07b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:18.644565 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c027d05-4a1a-4616-8370-51ea1bf0c07b None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:18.650150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 398/788] 10.222.0.39 () {56 vars in 1126 bytes} [Wed May 25 15:04:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:18.656538 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c027d05-4a1a-4616-8370-51ea1bf0c07b None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:18.694619 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:18.709091 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:18.731707 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd95f19-4a52-4e2d-ae5b-45104868c525 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:18.766874 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8b86c-0ac0-4067-811e-8e4ab5e2f68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:18.767546 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8b86c-0ac0-4067-811e-8e4ab5e2f68e None admin] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:18.767831 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8b86c-0ac0-4067-811e-8e4ab5e2f68e None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:18.767924 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c027d05-4a1a-4616-8370-51ea1bf0c07b None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:18.768107 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8b86c-0ac0-4067-811e-8e4ab5e2f68e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:18.768847 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8b86c-0ac0-4067-811e-8e4ab5e2f68e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:18.770262 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8b86c-0ac0-4067-811e-8e4ab5e2f68e None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:18.790124 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 391/789] 10.222.0.39 () {60 vars in 1144 bytes} [Wed May 25 15:04:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:04:18.812677 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ad0ef-80e1-4f3b-8416-377ce389ba1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:18.813357 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ad0ef-80e1-4f3b-8416-377ce389ba1f None admin] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:18.813639 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ad0ef-80e1-4f3b-8416-377ce389ba1f None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:18.813917 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ad0ef-80e1-4f3b-8416-377ce389ba1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:18.814755 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ad0ef-80e1-4f3b-8416-377ce389ba1f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:18.816272 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ad0ef-80e1-4f3b-8416-377ce389ba1f None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:18.840701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 399/790] 10.222.0.39 () {60 vars in 1144 bytes} [Wed May 25 15:04:18 2022] POST /identity/v3/endpoints => generated 347 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:04:21.172316 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8ee86-e987-4bce-974c-dcab0a3cad85 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:21.172850 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8ee86-e987-4bce-974c-dcab0a3cad85 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:21.172850 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8ee86-e987-4bce-974c-dcab0a3cad85 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:21.174373 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 392/791] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:04:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:21.180015 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bcbf8-8a78-41e5-886e-7db54a3734cd None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:21.180477 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bcbf8-8a78-41e5-886e-7db54a3734cd None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:21.180572 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bcbf8-8a78-41e5-886e-7db54a3734cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:21.191249 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6f937-2394-4f4d-b6a8-7afbf622c854 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:21.191542 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6f937-2394-4f4d-b6a8-7afbf622c854 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:21.191828 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6f937-2394-4f4d-b6a8-7afbf622c854 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:21.193753 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 393/792] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:04:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:21.198591 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4202e3-a8ca-4f28-91d1-642217055460 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:21.198880 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4202e3-a8ca-4f28-91d1-642217055460 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:21.199096 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-d86bcbf8-8a78-41e5-886e-7db54a3734cd None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:21.199211 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4202e3-a8ca-4f28-91d1-642217055460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:21.200337 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-d86bcbf8-8a78-41e5-886e-7db54a3734cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:21.216121 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-6b4202e3-a8ca-4f28-91d1-642217055460 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:21.217338 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-6b4202e3-a8ca-4f28-91d1-642217055460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:21.280159 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 400/793] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:04:21 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:04:21.292040 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 394/794] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:04:21 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:04:21.304295 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bcbf8-8a78-41e5-886e-7db54a3734cd None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:21.319028 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4202e3-a8ca-4f28-91d1-642217055460 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:21.331502 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:21.378118 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:21.410538 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bcbf8-8a78-41e5-886e-7db54a3734cd None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:21.425487 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4202e3-a8ca-4f28-91d1-642217055460 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:21.447120 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884fc4b-5fab-4a10-ab8b-f82a5f8b0809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:21.447937 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884fc4b-5fab-4a10-ab8b-f82a5f8b0809 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:21.448216 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884fc4b-5fab-4a10-ab8b-f82a5f8b0809 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:21.448488 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884fc4b-5fab-4a10-ab8b-f82a5f8b0809 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:21.449148 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884fc4b-5fab-4a10-ab8b-f82a5f8b0809 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:21.450570 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884fc4b-5fab-4a10-ab8b-f82a5f8b0809 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:21.463611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-7884fc4b-5fab-4a10-ab8b-f82a5f8b0809 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:04:21.463611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:21.463611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:04:21.463611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:04:21.463611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:04:21.463611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:04:21.463611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:04:21.463611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:21.463611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:04:21.463611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:21.463611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:04:21.463611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:21.463611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:21.463611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:21.463611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:21.463611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:21.463611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:21.464695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:21.464695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:21.464695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:21.464695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:21.464695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:21.464695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:21.464695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:04:21.464695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:04:21.464695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:04:21.464695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:04:21.464695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:21.464695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:21.464695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:21.464695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:21.464695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:21.464695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:21.465621 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:21.465621 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:04:21.465621 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:21.465621 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:21.465621 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:21.465621 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:21.465621 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:21.465621 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:21.465621 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:21.465621 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:21.465621 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:04:21.465621 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:21.465621 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:04:21.465621 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:21.465621 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 401/795] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:04:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:21.467374 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96124479-8276-48d1-9069-e07e02802767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:21.468223 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96124479-8276-48d1-9069-e07e02802767 None admin] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:21.468572 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96124479-8276-48d1-9069-e07e02802767 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:21.468856 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96124479-8276-48d1-9069-e07e02802767 None admin] PATH_INFO: `/v3/projects` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:21.469578 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96124479-8276-48d1-9069-e07e02802767 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:21.471095 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96124479-8276-48d1-9069-e07e02802767 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:21.472593 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: WARNING keystone.server.flask.common [None req-96124479-8276-48d1-9069-e07e02802767 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 25 15:04:21.472970 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884fc4b-5fab-4a10-ab8b-f82a5f8b0809 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:21.491030 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.sql.core [None req-96124479-8276-48d1-9069-e07e02802767 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 15:04:21.491030 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 15:04:21.491030 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [parameters: {'id': '5d12c75aec4743888bbac6c87f8e4997', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 15:04:21.491030 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87272) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 15:04:21.508115 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-96124479-8276-48d1-9069-e07e02802767 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5d12c75aec4743888bbac6c87f8e4997.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5d12c75aec4743888bbac6c87f8e4997. May 25 15:04:21.508115 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:21.508115 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 15:04:21.508115 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 15:04:21.508115 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 15:04:21.508115 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 15:04:21.508115 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 15:04:21.508115 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application result = self._query(query) May 25 15:04:21.508115 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 15:04:21.508115 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application conn.query(q) May 25 15:04:21.508115 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 15:04:21.508115 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 15:04:21.508115 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 15:04:21.509633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application result.read() May 25 15:04:21.509633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 15:04:21.509633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 15:04:21.509633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 15:04:21.509633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 15:04:21.509633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 15:04:21.509633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 15:04:21.509633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 15:04:21.509633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 15:04:21.509633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 15:04:21.509633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:21.509633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 15:04:21.509633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:21.509633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:21.509633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 15:04:21.509633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 15:04:21.509633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 25 15:04:21.509633 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return project_ref.to_dict() May 25 15:04:21.511410 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 15:04:21.511410 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application next(self.gen) May 25 15:04:21.511410 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 15:04:21.511410 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application yield resource May 25 15:04:21.511410 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 15:04:21.511410 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application next(self.gen) May 25 15:04:21.511410 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 15:04:21.511410 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self.session.rollback() May 25 15:04:21.511410 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 15:04:21.511410 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self.force_reraise() May 25 15:04:21.511410 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 15:04:21.511410 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise self.value May 25 15:04:21.511410 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 15:04:21.511410 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 15:04:21.511410 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 15:04:21.511410 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application session.commit() May 25 15:04:21.511410 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 15:04:21.513083 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 15:04:21.513083 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 15:04:21.513083 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self._prepare_impl() May 25 15:04:21.513083 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 15:04:21.513083 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self.session.flush() May 25 15:04:21.513083 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 15:04:21.513083 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self._flush(objects) May 25 15:04:21.513083 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 15:04:21.513083 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 15:04:21.513083 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 15:04:21.513083 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application compat.raise_( May 25 15:04:21.513083 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 15:04:21.513083 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception May 25 15:04:21.513083 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 15:04:21.513083 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application flush_context.execute() May 25 15:04:21.513083 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 15:04:21.513083 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rec.execute(self) May 25 15:04:21.516102 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 15:04:21.516102 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 15:04:21.516102 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 15:04:21.516102 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 15:04:21.516102 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 15:04:21.516102 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 15:04:21.516102 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 15:04:21.516102 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 15:04:21.516102 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 15:04:21.516102 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 15:04:21.516102 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 15:04:21.516102 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 15:04:21.516102 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 15:04:21.516102 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 15:04:21.516102 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 15:04:21.517921 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 15:04:21.517921 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 15:04:21.517921 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception May 25 15:04:21.517921 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 15:04:21.517921 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 15:04:21.517921 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 15:04:21.517921 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 15:04:21.517921 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 15:04:21.517921 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application result = self._query(query) May 25 15:04:21.517921 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 15:04:21.517921 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application conn.query(q) May 25 15:04:21.517921 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 15:04:21.517921 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 15:04:21.517921 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 15:04:21.517921 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application result.read() May 25 15:04:21.517921 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 15:04:21.517921 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 15:04:21.520715 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 15:04:21.520715 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 15:04:21.520715 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 15:04:21.520715 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 15:04:21.520715 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 15:04:21.520715 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 15:04:21.520715 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 15:04:21.520715 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 15:04:21.520715 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [parameters: {'id': '5d12c75aec4743888bbac6c87f8e4997', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 15:04:21.520715 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 15:04:21.520715 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:21.520715 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:04:21.520715 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:21.520715 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:21.520715 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 25 15:04:21.522465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 25 15:04:21.522465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 15:04:21.522465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 15:04:21.522465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 25 15:04:21.522465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:21.522465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:04:21.522465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:21.522465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:21.522465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:21.522465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:21.522465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:21.522465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:21.522465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:21.522465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:21.522465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:21.522465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:21.522465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:21.524250 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:21.524250 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 25 15:04:21.524250 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 25 15:04:21.524250 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:21.524250 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:21.524250 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 25 15:04:21.524250 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.Conflict( May 25 15:04:21.524250 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5d12c75aec4743888bbac6c87f8e4997. May 25 15:04:21.524250 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:21.524250 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 395/796] 10.222.0.39 () {60 vars in 1140 bytes} [Wed May 25 15:04:21 2022] POST /identity/v3/projects => generated 262 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:21.524250 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96124479-8276-48d1-9069-e07e02802767 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:21.574899 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:21.587911 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884fc4b-5fab-4a10-ab8b-f82a5f8b0809 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:21.622897 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2447eb-542a-42dd-b645-e99707920b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:21.623558 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2447eb-542a-42dd-b645-e99707920b7c None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:21.623824 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2447eb-542a-42dd-b645-e99707920b7c None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:21.624157 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2447eb-542a-42dd-b645-e99707920b7c None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:21.624881 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2447eb-542a-42dd-b645-e99707920b7c None admin] RBAC: Adding query filter params (name=compute) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:21.625180 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2447eb-542a-42dd-b645-e99707920b7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:21.626589 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2447eb-542a-42dd-b645-e99707920b7c None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:21.627904 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96124479-8276-48d1-9069-e07e02802767 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:21.631671 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 402/797] 10.222.0.39 () {56 vars in 1112 bytes} [Wed May 25 15:04:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:21.637354 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2447eb-542a-42dd-b645-e99707920b7c None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:21.642201 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:21.669742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13560860-1681-470a-8018-1120d6880f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:21.670603 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13560860-1681-470a-8018-1120d6880f2e None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:21.671106 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13560860-1681-470a-8018-1120d6880f2e None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:21.672616 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13560860-1681-470a-8018-1120d6880f2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:21.679023 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13560860-1681-470a-8018-1120d6880f2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:21.680620 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13560860-1681-470a-8018-1120d6880f2e None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:21.695574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-13560860-1681-470a-8018-1120d6880f2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:04:21.695574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:21.695574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:21.695574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:21.695574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:21.695574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:21.695574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:21.695574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:21.695574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:21.695574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:21.695574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:21.695574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:21.695574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:04:21.695574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:04:21.695574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:04:21.696601 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:04:21.696601 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:21.696601 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:21.696601 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:21.696601 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:21.696601 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:21.696601 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:21.696601 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:21.696601 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:04:21.696601 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:21.696601 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:21.696601 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:21.696601 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:21.696601 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:21.696601 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:21.696601 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:21.696601 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:21.697480 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:04:21.697480 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:04:21.697480 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:04:21.697480 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:04:21.697480 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:04:21.697480 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:04:21.697480 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:04:21.697480 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:21.697480 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 396/798] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:04:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:04:21.702754 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13560860-1681-470a-8018-1120d6880f2e None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:21.743898 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2447eb-542a-42dd-b645-e99707920b7c None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:21.778340 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ab96c-44e1-4eb7-b0e1-0ae3c73bb61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:21.779030 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ab96c-44e1-4eb7-b0e1-0ae3c73bb61c None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:21.779317 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ab96c-44e1-4eb7-b0e1-0ae3c73bb61c None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:21.779589 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ab96c-44e1-4eb7-b0e1-0ae3c73bb61c None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:21.780322 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ab96c-44e1-4eb7-b0e1-0ae3c73bb61c None admin] RBAC: Adding query filter params (type=compute) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:21.781301 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ab96c-44e1-4eb7-b0e1-0ae3c73bb61c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:21.783055 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ab96c-44e1-4eb7-b0e1-0ae3c73bb61c None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:21.788125 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 403/799] 10.222.0.39 () {56 vars in 1112 bytes} [Wed May 25 15:04:21 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:04:21.808848 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13560860-1681-470a-8018-1120d6880f2e None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:21.849048 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbded21-e554-4897-ae75-3f5a78dd8240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:21.849740 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbded21-e554-4897-ae75-3f5a78dd8240 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:21.850004 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbded21-e554-4897-ae75-3f5a78dd8240 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:21.850275 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbded21-e554-4897-ae75-3f5a78dd8240 None admin] PATH_INFO: `/v3/projects` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:21.851090 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbded21-e554-4897-ae75-3f5a78dd8240 None admin] RBAC: Adding query filter params (name=service) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:21.851395 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbded21-e554-4897-ae75-3f5a78dd8240 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:21.852891 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbded21-e554-4897-ae75-3f5a78dd8240 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:21.875932 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 397/800] 10.222.0.39 () {56 vars in 1112 bytes} [Wed May 25 15:04:21 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:04:24.154495 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b94ad0-5c99-4d52-8195-9fe867a12e5d None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:24.155057 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b94ad0-5c99-4d52-8195-9fe867a12e5d None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:24.155057 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b94ad0-5c99-4d52-8195-9fe867a12e5d None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:24.156450 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 404/801] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:24.162066 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a886af-c467-4ce0-bd60-2d8d424b865d None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:24.162530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a886af-c467-4ce0-bd60-2d8d424b865d None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:24.162704 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a886af-c467-4ce0-bd60-2d8d424b865d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:24.181777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-85a886af-c467-4ce0-bd60-2d8d424b865d None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:24.183354 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-85a886af-c467-4ce0-bd60-2d8d424b865d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:24.210072 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:24.221549 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33c90a-c45c-4ef0-b7be-94c4b0ef5673 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:24.221841 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33c90a-c45c-4ef0-b7be-94c4b0ef5673 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:24.222117 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33c90a-c45c-4ef0-b7be-94c4b0ef5673 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:24.223696 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 405/802] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:04:24.229311 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8bfd4-1ee6-46ce-b674-13f6e98da26f None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:24.229605 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8bfd4-1ee6-46ce-b674-13f6e98da26f None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:24.229880 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8bfd4-1ee6-46ce-b674-13f6e98da26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:24.247165 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-59a8bfd4-1ee6-46ce-b674-13f6e98da26f None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:24.248396 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-59a8bfd4-1ee6-46ce-b674-13f6e98da26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:24.260458 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:24.261712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 398/803] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:04:24 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:04:24.287214 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a886af-c467-4ce0-bd60-2d8d424b865d None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:24.331851 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 406/804] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:04:24 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:04:24.359141 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8bfd4-1ee6-46ce-b674-13f6e98da26f None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:24.403459 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a886af-c467-4ce0-bd60-2d8d424b865d None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:24.444448 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34105f9-6db1-4e7b-be80-f5807c7a6f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:24.445044 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34105f9-6db1-4e7b-be80-f5807c7a6f10 None admin] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:24.445327 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34105f9-6db1-4e7b-be80-f5807c7a6f10 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:24.445616 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34105f9-6db1-4e7b-be80-f5807c7a6f10 None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:24.446381 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34105f9-6db1-4e7b-be80-f5807c7a6f10 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:24.447779 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34105f9-6db1-4e7b-be80-f5807c7a6f10 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:24.464491 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 399/805] 10.222.0.39 () {60 vars in 1141 bytes} [Wed May 25 15:04:24 2022] POST /identity/v3/services => generated 242 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:04:24.472841 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8bfd4-1ee6-46ce-b674-13f6e98da26f None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:24.525201 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7e8fa-5b22-4bed-9dae-6774e217a635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:24.525927 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7e8fa-5b22-4bed-9dae-6774e217a635 None admin] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:24.526207 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7e8fa-5b22-4bed-9dae-6774e217a635 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:24.526502 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7e8fa-5b22-4bed-9dae-6774e217a635 None admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:24.527217 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7e8fa-5b22-4bed-9dae-6774e217a635 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:24.528729 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7e8fa-5b22-4bed-9dae-6774e217a635 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:24.530203 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: WARNING keystone.server.flask.common [None req-dce7e8fa-5b22-4bed-9dae-6774e217a635 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 25 15:04:24.544890 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.sql.core [None req-dce7e8fa-5b22-4bed-9dae-6774e217a635 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 15:04:24.544890 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 15:04:24.544890 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [parameters: {'user_id': '06672ff88b6a4beebfef16fc6e520d5f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 15:04:24.544890 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87273) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 15:04:24.562471 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-dce7e8fa-5b22-4bed-9dae-6774e217a635 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 15:04:24.562471 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:24.562471 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 15:04:24.562471 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 15:04:24.562471 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 15:04:24.562471 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 15:04:24.562471 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 15:04:24.562471 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application result = self._query(query) May 25 15:04:24.562471 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 15:04:24.562471 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application conn.query(q) May 25 15:04:24.562471 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 15:04:24.562471 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 15:04:24.562471 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 15:04:24.562471 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application result.read() May 25 15:04:24.562471 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 15:04:24.563560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 15:04:24.563560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 15:04:24.563560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 15:04:24.563560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 15:04:24.563560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 15:04:24.563560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 15:04:24.563560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 15:04:24.563560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 15:04:24.563560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:24.563560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 15:04:24.563560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:24.563560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:24.563560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 15:04:24.563560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 15:04:24.563560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 25 15:04:24.563560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 25 15:04:24.563560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 15:04:24.563560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application next(self.gen) May 25 15:04:24.564496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 15:04:24.564496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application yield resource May 25 15:04:24.564496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 15:04:24.564496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application next(self.gen) May 25 15:04:24.564496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 15:04:24.564496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application self.session.rollback() May 25 15:04:24.564496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 15:04:24.564496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application self.force_reraise() May 25 15:04:24.564496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 15:04:24.564496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise self.value May 25 15:04:24.564496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 15:04:24.564496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 15:04:24.564496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 15:04:24.564496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application session.commit() May 25 15:04:24.564496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 15:04:24.564496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 15:04:24.564496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 15:04:24.565366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application self._prepare_impl() May 25 15:04:24.565366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 15:04:24.565366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application self.session.flush() May 25 15:04:24.565366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 15:04:24.565366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application self._flush(objects) May 25 15:04:24.565366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 15:04:24.565366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 15:04:24.565366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 15:04:24.565366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application compat.raise_( May 25 15:04:24.565366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 15:04:24.565366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception May 25 15:04:24.565366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 15:04:24.565366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application flush_context.execute() May 25 15:04:24.565366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 15:04:24.565366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rec.execute(self) May 25 15:04:24.565366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 15:04:24.565366 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 15:04:24.566303 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 15:04:24.566303 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 15:04:24.566303 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 25 15:04:24.566303 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application result = connection._execute_20( May 25 15:04:24.566303 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 15:04:24.566303 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 15:04:24.566303 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 15:04:24.566303 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 15:04:24.566303 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 15:04:24.566303 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 15:04:24.566303 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 15:04:24.566303 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 15:04:24.566303 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 15:04:24.566303 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 15:04:24.566303 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 15:04:24.566303 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception May 25 15:04:24.567150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 15:04:24.567150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 15:04:24.567150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 15:04:24.567150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 15:04:24.567150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 15:04:24.567150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application result = self._query(query) May 25 15:04:24.567150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 15:04:24.567150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application conn.query(q) May 25 15:04:24.567150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 15:04:24.567150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 15:04:24.567150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 15:04:24.567150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application result.read() May 25 15:04:24.567150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 15:04:24.567150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 15:04:24.567150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 15:04:24.567150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 15:04:24.569157 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 15:04:24.569157 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 15:04:24.569157 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 15:04:24.569157 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 15:04:24.569157 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 15:04:24.569157 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 15:04:24.569157 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [parameters: {'user_id': '06672ff88b6a4beebfef16fc6e520d5f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 15:04:24.569157 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 15:04:24.569157 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:24.569157 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:04:24.569157 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:24.569157 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:24.569157 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:24.569157 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:24.569157 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:24.570455 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:24.570455 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:24.570455 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:24.570455 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:24.570455 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:24.570455 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:24.570455 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:24.570455 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 25 15:04:24.570455 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 25 15:04:24.570455 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:24.570455 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:24.570455 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:04:24.570455 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:04:24.570455 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:04:24.570455 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:04:24.570455 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 25 15:04:24.570455 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 25 15:04:24.571872 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 25 15:04:24.571872 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 25 15:04:24.571872 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 15:04:24.571872 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 15:04:24.571872 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 15:04:24.571872 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:24.571872 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 407/806] 10.222.0.39 () {60 vars in 1131 bytes} [Wed May 25 15:04:24 2022] POST /identity/v3/users => generated 160 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:24.572361 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34105f9-6db1-4e7b-be80-f5807c7a6f10 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:24.596784 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:24.693713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34105f9-6db1-4e7b-be80-f5807c7a6f10 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:24.729842 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e321b7-cedb-45a4-826d-d768a6b6cbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:24.730601 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e321b7-cedb-45a4-826d-d768a6b6cbc4 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:24.730879 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e321b7-cedb-45a4-826d-d768a6b6cbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:24.731148 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e321b7-cedb-45a4-826d-d768a6b6cbc4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:24.738964 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e321b7-cedb-45a4-826d-d768a6b6cbc4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:24.740410 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e321b7-cedb-45a4-826d-d768a6b6cbc4 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:24.755896 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-b6e321b7-cedb-45a4-826d-d768a6b6cbc4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 15:04:24.755896 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:24.755896 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:24.755896 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:24.755896 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:24.755896 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:24.755896 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:24.755896 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:24.755896 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:24.755896 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:24.755896 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:24.755896 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:24.755896 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:04:24.755896 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:04:24.755896 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:04:24.755896 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:04:24.756925 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:24.756925 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:24.756925 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:04:24.756925 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:04:24.756925 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:04:24.756925 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:04:24.756925 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:24.756925 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:24.756925 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:24.756925 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:24.756925 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:24.756925 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:04:24.756925 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:24.756925 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:24.756925 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:24.756925 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:24.756925 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:24.756925 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:24.757895 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:24.757895 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:24.757895 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:04:24.757895 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:04:24.757895 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:04:24.757895 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:04:24.757895 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:04:24.757895 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:04:24.757895 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 15:04:24.757895 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:24.757895 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 400/807] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:04:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:04:24.763361 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7e8fa-5b22-4bed-9dae-6774e217a635 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:24.767682 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:24.875759 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7e8fa-5b22-4bed-9dae-6774e217a635 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:24.911820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad31a6e-5eab-4554-b7b7-bfe437486363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:24.912497 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad31a6e-5eab-4554-b7b7-bfe437486363 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:24.912775 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad31a6e-5eab-4554-b7b7-bfe437486363 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:24.913044 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad31a6e-5eab-4554-b7b7-bfe437486363 None admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:24.918758 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad31a6e-5eab-4554-b7b7-bfe437486363 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:24.918758 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad31a6e-5eab-4554-b7b7-bfe437486363 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:24.918758 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad31a6e-5eab-4554-b7b7-bfe437486363 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:24.961423 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 408/808] 10.222.0.39 () {56 vars in 1101 bytes} [Wed May 25 15:04:24 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:26.828721 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ce7b7-3231-46a2-9f3a-6e8de3740a23 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:26.829315 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ce7b7-3231-46a2-9f3a-6e8de3740a23 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:26.829696 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ce7b7-3231-46a2-9f3a-6e8de3740a23 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:26.831951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 401/809] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:04:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:26.838321 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c212b5-b230-4e78-94fc-b147ff498a8b None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:26.838843 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c212b5-b230-4e78-94fc-b147ff498a8b None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:26.838935 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c212b5-b230-4e78-94fc-b147ff498a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:26.856870 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-77c212b5-b230-4e78-94fc-b147ff498a8b None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:26.858743 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-77c212b5-b230-4e78-94fc-b147ff498a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:26.919267 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:26.931373 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 409/810] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:04:26 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:04:26.955419 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ce7b7-3231-46a2-9f3a-6e8de3740a23 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:27.048101 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:27.071965 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ce7b7-3231-46a2-9f3a-6e8de3740a23 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:27.107236 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7539d-7e6d-46c6-b4ad-305fc2f98a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:27.107948 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7539d-7e6d-46c6-b4ad-305fc2f98a0d None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:27.108253 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7539d-7e6d-46c6-b4ad-305fc2f98a0d None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:27.108533 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7539d-7e6d-46c6-b4ad-305fc2f98a0d None admin] PATH_INFO: `/v3/services/compute` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:27.109315 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7539d-7e6d-46c6-b4ad-305fc2f98a0d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:27.110814 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7539d-7e6d-46c6-b4ad-305fc2f98a0d None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:27.123272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-59b7539d-7e6d-46c6-b4ad-305fc2f98a0d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:04:27.123272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:27.123272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:04:27.123272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:04:27.123272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:04:27.123272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:04:27.123272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:04:27.123272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:27.123272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:04:27.123272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:27.123272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:04:27.123272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:27.123272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:27.123272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:27.123272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:27.123272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:27.123272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:27.124636 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:27.124636 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:27.124636 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:27.124636 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:27.124636 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:27.124636 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:27.124636 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:04:27.124636 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:04:27.124636 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:04:27.124636 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:04:27.124636 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:27.124636 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:27.124636 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:27.124636 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:27.124636 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:27.124636 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:27.125504 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:27.125504 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:04:27.125504 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:27.125504 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:27.125504 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:27.125504 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:27.125504 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:27.125504 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:27.125504 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:27.125504 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:27.125504 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:04:27.125504 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:27.125504 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:04:27.125504 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:04:27.125504 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 402/811] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:04:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:27.132612 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c212b5-b230-4e78-94fc-b147ff498a8b None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:27.246510 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c212b5-b230-4e78-94fc-b147ff498a8b None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:27.282365 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c403050-a48d-481a-b777-e8ea85636682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:27.283028 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c403050-a48d-481a-b777-e8ea85636682 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:27.283307 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c403050-a48d-481a-b777-e8ea85636682 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:27.283574 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c403050-a48d-481a-b777-e8ea85636682 None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:27.284268 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c403050-a48d-481a-b777-e8ea85636682 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:27.284576 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c403050-a48d-481a-b777-e8ea85636682 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:27.285953 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c403050-a48d-481a-b777-e8ea85636682 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:27.290995 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 410/812] 10.222.0.39 () {56 vars in 1112 bytes} [Wed May 25 15:04:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:27.296895 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7539d-7e6d-46c6-b4ad-305fc2f98a0d None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:27.402454 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7539d-7e6d-46c6-b4ad-305fc2f98a0d None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:27.438463 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b29d3-259b-4503-a893-98592f69b40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:27.439130 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b29d3-259b-4503-a893-98592f69b40f None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:27.439430 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b29d3-259b-4503-a893-98592f69b40f None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:27.439710 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b29d3-259b-4503-a893-98592f69b40f None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:27.440416 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b29d3-259b-4503-a893-98592f69b40f None admin] RBAC: Adding query filter params (type=compute) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:27.440729 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b29d3-259b-4503-a893-98592f69b40f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:27.442091 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b29d3-259b-4503-a893-98592f69b40f None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:27.447085 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 403/813] 10.222.0.39 () {56 vars in 1112 bytes} [Wed May 25 15:04:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:27.453256 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c403050-a48d-481a-b777-e8ea85636682 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:27.526227 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:27.580862 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c403050-a48d-481a-b777-e8ea85636682 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:27.616274 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a4de9-ca23-46df-8602-2c3da657f622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:27.616927 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a4de9-ca23-46df-8602-2c3da657f622 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:27.617204 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a4de9-ca23-46df-8602-2c3da657f622 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:27.617474 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a4de9-ca23-46df-8602-2c3da657f622 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:27.618289 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a4de9-ca23-46df-8602-2c3da657f622 None admin] RBAC: Adding query filter params (interface=public, service_id=dc43162cb77c49b485c5e9312a162935, region_id=RegionOne) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:27.618587 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a4de9-ca23-46df-8602-2c3da657f622 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:27.619948 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a4de9-ca23-46df-8602-2c3da657f622 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:27.625611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 411/814] 10.222.0.39 () {56 vars in 1251 bytes} [Wed May 25 15:04:27 2022] GET /identity/v3/endpoints?service_id=dc43162cb77c49b485c5e9312a162935&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:27.631435 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b29d3-259b-4503-a893-98592f69b40f None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:27.644877 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:27.746358 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b29d3-259b-4503-a893-98592f69b40f None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:27.783238 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc8005-8234-46ac-ab0d-4c7d7b96cd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:27.783911 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc8005-8234-46ac-ab0d-4c7d7b96cd0a None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:27.784199 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc8005-8234-46ac-ab0d-4c7d7b96cd0a None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:27.784475 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc8005-8234-46ac-ab0d-4c7d7b96cd0a None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:27.785159 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc8005-8234-46ac-ab0d-4c7d7b96cd0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:27.786583 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc8005-8234-46ac-ab0d-4c7d7b96cd0a None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:27.793112 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 404/815] 10.222.0.39 () {56 vars in 1087 bytes} [Wed May 25 15:04:27 2022] GET /identity/v3/services => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:04:30.052385 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3a8cc-ef0f-4157-adc7-6988f23c0f57 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:30.052973 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3a8cc-ef0f-4157-adc7-6988f23c0f57 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:30.052973 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3a8cc-ef0f-4157-adc7-6988f23c0f57 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:30.054319 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 412/816] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:04:30.060115 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec44f0-c312-4e93-9010-7a4224e807af None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:30.060547 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec44f0-c312-4e93-9010-7a4224e807af None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:30.060635 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec44f0-c312-4e93-9010-7a4224e807af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:30.087313 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-beec44f0-c312-4e93-9010-7a4224e807af None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:04:30.089339 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-beec44f0-c312-4e93-9010-7a4224e807af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:04:30.201970 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 405/817] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:04:30 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:04:30.225894 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3a8cc-ef0f-4157-adc7-6988f23c0f57 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:30.338420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3a8cc-ef0f-4157-adc7-6988f23c0f57 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:30.360493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:30.376993 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee61fd-c47f-4a67-9506-252184684481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:30.377821 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee61fd-c47f-4a67-9506-252184684481 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:30.378084 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee61fd-c47f-4a67-9506-252184684481 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:30.378398 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee61fd-c47f-4a67-9506-252184684481 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:30.379052 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee61fd-c47f-4a67-9506-252184684481 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:30.380441 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee61fd-c47f-4a67-9506-252184684481 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:30.393089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-efee61fd-c47f-4a67-9506-252184684481 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:04:30.393089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:30.393089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:04:30.393089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:04:30.393089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:04:30.393089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:04:30.393089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:04:30.393089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:30.393089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:04:30.393089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:30.393089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:04:30.393089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:30.393089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:04:30.393089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:04:30.393089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:04:30.393089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:04:30.393089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:04:30.394329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:04:30.394329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:04:30.394329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:04:30.394329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:04:30.394329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:04:30.394329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:04:30.394329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:04:30.394329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:04:30.394329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:04:30.394329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:04:30.394329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:04:30.394329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:04:30.394329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:04:30.394329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:04:30.394329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:04:30.394329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:04:30.395436 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:04:30.395436 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:04:30.395436 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:04:30.395436 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:04:30.395436 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:04:30.395436 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:04:30.395436 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:04:30.395436 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:04:30.395436 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:04:30.395436 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:04:30.395436 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:04:30.395436 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:04:30.395436 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:04:30.395436 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:04:30.395436 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 413/818] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:04:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:04:30.402001 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec44f0-c312-4e93-9010-7a4224e807af None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:30.404289 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:30.509454 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec44f0-c312-4e93-9010-7a4224e807af None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:30.547842 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025a593-6112-43b6-af94-bea11654186e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:30.548511 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025a593-6112-43b6-af94-bea11654186e None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:30.548792 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025a593-6112-43b6-af94-bea11654186e None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:30.549069 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025a593-6112-43b6-af94-bea11654186e None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:30.549778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025a593-6112-43b6-af94-bea11654186e None admin] RBAC: Adding query filter params (name=compute) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:30.550086 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025a593-6112-43b6-af94-bea11654186e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:30.551533 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025a593-6112-43b6-af94-bea11654186e None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:30.557281 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 406/819] 10.222.0.39 () {56 vars in 1112 bytes} [Wed May 25 15:04:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:30.563284 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee61fd-c47f-4a67-9506-252184684481 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:30.669563 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee61fd-c47f-4a67-9506-252184684481 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:30.706072 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df9871-c95e-4def-b35a-14e716b113f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:30.706771 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df9871-c95e-4def-b35a-14e716b113f0 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:30.707045 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df9871-c95e-4def-b35a-14e716b113f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:30.707317 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df9871-c95e-4def-b35a-14e716b113f0 None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:30.708020 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df9871-c95e-4def-b35a-14e716b113f0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:04:30.708322 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df9871-c95e-4def-b35a-14e716b113f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:30.709695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df9871-c95e-4def-b35a-14e716b113f0 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:30.715187 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 414/820] 10.222.0.39 () {56 vars in 1112 bytes} [Wed May 25 15:04:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:04:30.724792 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025a593-6112-43b6-af94-bea11654186e None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:04:30.797254 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:30.834192 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025a593-6112-43b6-af94-bea11654186e None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:04:30.869951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f8579-6322-4a5b-a094-71c180479526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:04:30.870640 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f8579-6322-4a5b-a094-71c180479526 None admin] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:04:30.870924 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f8579-6322-4a5b-a094-71c180479526 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:04:30.871201 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f8579-6322-4a5b-a094-71c180479526 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:04:30.871940 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f8579-6322-4a5b-a094-71c180479526 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:04:30.873313 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f8579-6322-4a5b-a094-71c180479526 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:04:30.895309 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 407/821] 10.222.0.39 () {60 vars in 1144 bytes} [Wed May 25 15:04:30 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:04:40.712329 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=76 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:04:40.889274 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:35.767929 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3ccda-e744-4265-8d93-d99718b07aca None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:35.768809 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3ccda-e744-4265-8d93-d99718b07aca None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:35.768809 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3ccda-e744-4265-8d93-d99718b07aca None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:35.769794 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 415/822] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:05:35.779308 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b4b4e-5f72-458f-b1ce-4e7e40746cb4 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:35.780129 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b4b4e-5f72-458f-b1ce-4e7e40746cb4 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:35.780129 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b4b4e-5f72-458f-b1ce-4e7e40746cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:35.802201 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-e27b4b4e-5f72-458f-b1ce-4e7e40746cb4 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:35.803680 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-e27b4b4e-5f72-458f-b1ce-4e7e40746cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:35.930177 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 408/823] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:05:35 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:05:35.969701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3ccda-e744-4265-8d93-d99718b07aca None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:36.153228 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3ccda-e744-4265-8d93-d99718b07aca None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:36.207811 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde61a0-b0b3-49ab-a877-ab81c472eb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:36.208779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde61a0-b0b3-49ab-a877-ab81c472eb94 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:36.209217 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde61a0-b0b3-49ab-a877-ab81c472eb94 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:36.209393 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde61a0-b0b3-49ab-a877-ab81c472eb94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:36.227142 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde61a0-b0b3-49ab-a877-ab81c472eb94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:36.229601 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde61a0-b0b3-49ab-a877-ab81c472eb94 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:36.265147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-ffde61a0-b0b3-49ab-a877-ab81c472eb94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:05:36.265147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:05:36.265147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:05:36.265147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:05:36.265147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:05:36.265147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:05:36.265147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:05:36.265147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:05:36.265147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:05:36.265147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:05:36.265147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:05:36.265147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:05:36.265147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:05:36.265147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:05:36.265147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:05:36.266402 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:05:36.266402 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:05:36.266402 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:05:36.266402 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:05:36.266402 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:05:36.266402 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:05:36.266402 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:05:36.266402 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:05:36.266402 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:05:36.266402 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:05:36.266402 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:05:36.266402 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:05:36.266402 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:05:36.266402 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:05:36.266402 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:05:36.266402 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:05:36.266402 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:05:36.267536 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:05:36.267536 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:05:36.267536 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:05:36.267536 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:05:36.267884 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 416/824] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:05:36.276364 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b4b4e-5f72-458f-b1ce-4e7e40746cb4 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:36.462312 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b4b4e-5f72-458f-b1ce-4e7e40746cb4 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:36.510547 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:36.525785 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8704263-b102-4292-8e84-4fa61bcad8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:36.526747 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8704263-b102-4292-8e84-4fa61bcad8c7 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:36.527278 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8704263-b102-4292-8e84-4fa61bcad8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:36.527686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8704263-b102-4292-8e84-4fa61bcad8c7 None admin] PATH_INFO: `/v3/domains` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:36.528996 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8704263-b102-4292-8e84-4fa61bcad8c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:36.529628 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8704263-b102-4292-8e84-4fa61bcad8c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:36.531779 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8704263-b102-4292-8e84-4fa61bcad8c7 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:36.554364 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 409/825] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:05:36.563571 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde61a0-b0b3-49ab-a877-ab81c472eb94 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:36.665431 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:36.749129 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde61a0-b0b3-49ab-a877-ab81c472eb94 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:36.809220 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f65d0-be78-4fb0-b6bd-545a8606e9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:36.811321 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f65d0-be78-4fb0-b6bd-545a8606e9e8 None admin] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:36.811751 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f65d0-be78-4fb0-b6bd-545a8606e9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:36.812147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f65d0-be78-4fb0-b6bd-545a8606e9e8 None admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:36.813352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f65d0-be78-4fb0-b6bd-545a8606e9e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:36.815421 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f65d0-be78-4fb0-b6bd-545a8606e9e8 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:36.848115 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 417/826] 10.222.0.39 () {60 vars in 1132 bytes} [Wed May 25 15:05:36 2022] POST /identity/v3/users => generated 251 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:05:39.467907 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bb23e-df25-44e0-b34c-ff79ddbbf223 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:39.468565 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bb23e-df25-44e0-b34c-ff79ddbbf223 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:39.468923 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568bb23e-df25-44e0-b34c-ff79ddbbf223 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:39.471904 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 410/827] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:05:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:05:39.480527 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e3871-91d2-4f3c-8af3-c0db77a4e310 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:39.481405 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e3871-91d2-4f3c-8af3-c0db77a4e310 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:39.481405 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e3871-91d2-4f3c-8af3-c0db77a4e310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:39.509771 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-2d4e3871-91d2-4f3c-8af3-c0db77a4e310 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:39.511702 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-2d4e3871-91d2-4f3c-8af3-c0db77a4e310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:39.620441 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 418/828] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:05:39 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:05:39.652091 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568bb23e-df25-44e0-b34c-ff79ddbbf223 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:39.803745 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568bb23e-df25-44e0-b34c-ff79ddbbf223 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:39.857191 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de926712-09eb-48ac-8a15-ec5efd84454c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:39.858171 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de926712-09eb-48ac-8a15-ec5efd84454c None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:39.858596 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de926712-09eb-48ac-8a15-ec5efd84454c None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:39.859023 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de926712-09eb-48ac-8a15-ec5efd84454c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:39.877298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de926712-09eb-48ac-8a15-ec5efd84454c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:05:39.889188 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-de926712-09eb-48ac-8a15-ec5efd84454c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:05:39.889188 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:05:39.889188 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:05:39.889188 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:05:39.889188 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:05:39.889188 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:05:39.889188 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:05:39.889188 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:05:39.889188 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:05:39.889188 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:05:39.889188 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:05:39.889188 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:05:39.889188 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:05:39.889188 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:05:39.889188 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:05:39.889188 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:05:39.890713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:05:39.890713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:05:39.890713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:05:39.890713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:05:39.890713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:05:39.890713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:05:39.890713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:05:39.890713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:05:39.890713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:05:39.890713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:05:39.890713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:05:39.890713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:05:39.890713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:05:39.890713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:05:39.890713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:05:39.890713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:05:39.892112 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:05:39.892112 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:05:39.892112 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:05:39.892112 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:05:39.892112 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:05:39.892112 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:05:39.892112 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:05:39.892112 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:05:39.892112 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:05:39.892112 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:05:39.892112 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:05:39.892112 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:05:39.892112 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 411/829] 10.222.0.39 () {56 vars in 1102 bytes} [Wed May 25 15:05:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:05:39.900421 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e3871-91d2-4f3c-8af3-c0db77a4e310 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:39.957791 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:40.070377 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e3871-91d2-4f3c-8af3-c0db77a4e310 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:40.126918 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242db6fd-3858-49e7-958e-b6d202e7849b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:40.127677 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242db6fd-3858-49e7-958e-b6d202e7849b None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:40.127991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242db6fd-3858-49e7-958e-b6d202e7849b None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:40.128338 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242db6fd-3858-49e7-958e-b6d202e7849b None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:40.129275 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242db6fd-3858-49e7-958e-b6d202e7849b None admin] RBAC: Adding query filter params (name=service) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:40.129631 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242db6fd-3858-49e7-958e-b6d202e7849b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:40.131227 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242db6fd-3858-49e7-958e-b6d202e7849b None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:40.146004 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 419/830] 10.222.0.39 () {56 vars in 1103 bytes} [Wed May 25 15:05:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:05:40.152215 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de926712-09eb-48ac-8a15-ec5efd84454c None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:40.218767 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:40.305368 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de926712-09eb-48ac-8a15-ec5efd84454c None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:40.356942 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9166739-4d34-445d-a852-0a4915272f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:40.358000 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9166739-4d34-445d-a852-0a4915272f86 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:40.358431 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9166739-4d34-445d-a852-0a4915272f86 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:40.358850 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9166739-4d34-445d-a852-0a4915272f86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:40.375475 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9166739-4d34-445d-a852-0a4915272f86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:40.377411 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9166739-4d34-445d-a852-0a4915272f86 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:40.405383 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-e9166739-4d34-445d-a852-0a4915272f86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:05:40.405383 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:05:40.405383 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:05:40.405383 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:05:40.405383 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:05:40.405383 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:05:40.405383 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:05:40.405383 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:05:40.405383 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:05:40.405383 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:05:40.405383 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:05:40.405383 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:05:40.405383 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:05:40.405383 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:05:40.405383 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:05:40.407494 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:05:40.407494 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:05:40.407494 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:05:40.407494 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:05:40.407494 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:05:40.407494 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:05:40.407494 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:05:40.407494 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:05:40.407494 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:05:40.407494 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:05:40.407494 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:05:40.407494 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:05:40.407494 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:05:40.407494 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:05:40.407494 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:05:40.407494 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:05:40.407494 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:05:40.409151 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:05:40.409151 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:05:40.409151 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:05:40.409151 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:05:40.409151 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 412/831] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:05:40.413966 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242db6fd-3858-49e7-958e-b6d202e7849b None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:40.570454 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:40.576090 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242db6fd-3858-49e7-958e-b6d202e7849b None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:40.644692 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc5b61-aeb5-4ccc-8301-3bc28db3461e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:40.645276 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc5b61-aeb5-4ccc-8301-3bc28db3461e None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:40.645967 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc5b61-aeb5-4ccc-8301-3bc28db3461e None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:40.646594 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc5b61-aeb5-4ccc-8301-3bc28db3461e None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:40.648053 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc5b61-aeb5-4ccc-8301-3bc28db3461e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:40.648619 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc5b61-aeb5-4ccc-8301-3bc28db3461e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:40.651721 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc5b61-aeb5-4ccc-8301-3bc28db3461e None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:40.692088 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 420/832] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:05:40.693448 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9166739-4d34-445d-a852-0a4915272f86 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:40.820064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:40.824792 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9166739-4d34-445d-a852-0a4915272f86 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:40.867635 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92694ab8-404d-47cf-940e-53e40f5939c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:40.868989 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92694ab8-404d-47cf-940e-53e40f5939c3 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:40.869469 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92694ab8-404d-47cf-940e-53e40f5939c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:40.869933 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92694ab8-404d-47cf-940e-53e40f5939c3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:40.884288 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92694ab8-404d-47cf-940e-53e40f5939c3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:40.887020 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92694ab8-404d-47cf-940e-53e40f5939c3 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:40.915599 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-92694ab8-404d-47cf-940e-53e40f5939c3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 15:05:40.915599 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:05:40.915599 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:05:40.915599 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:05:40.915599 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:05:40.915599 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:05:40.915599 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:05:40.915599 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:05:40.915599 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:05:40.915599 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:05:40.915599 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:05:40.915599 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:05:40.915599 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:05:40.915599 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:05:40.915599 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:05:40.915599 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:05:40.923631 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:05:40.923631 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:05:40.923631 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:05:40.923631 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:05:40.923631 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:05:40.923631 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:05:40.923631 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:05:40.923631 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:05:40.923631 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:05:40.923631 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:05:40.923631 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:05:40.923631 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:05:40.923631 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:05:40.923631 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:05:40.923631 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:05:40.923631 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:05:40.923631 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:05:40.923631 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:05:40.925706 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:05:40.925706 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:05:40.925706 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:05:40.925706 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:05:40.925706 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:05:40.925706 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:05:40.925706 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:05:40.925706 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:05:40.925706 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 15:05:40.925706 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:05:40.925706 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 413/833] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:05:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:05:40.927003 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc5b61-aeb5-4ccc-8301-3bc28db3461e None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:41.087565 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc5b61-aeb5-4ccc-8301-3bc28db3461e None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:41.147567 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5906258-9a4f-4f3d-b615-f2c9b2f9a1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:41.148451 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5906258-9a4f-4f3d-b615-f2c9b2f9a1dd None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:41.148775 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5906258-9a4f-4f3d-b615-f2c9b2f9a1dd None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:41.149162 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5906258-9a4f-4f3d-b615-f2c9b2f9a1dd None admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:41.150162 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5906258-9a4f-4f3d-b615-f2c9b2f9a1dd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:41.150623 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5906258-9a4f-4f3d-b615-f2c9b2f9a1dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:41.152347 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5906258-9a4f-4f3d-b615-f2c9b2f9a1dd None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:41.184995 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 421/834] 10.222.0.39 () {56 vars in 1143 bytes} [Wed May 25 15:05:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:05:41.194454 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92694ab8-404d-47cf-940e-53e40f5939c3 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:41.355409 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92694ab8-404d-47cf-940e-53e40f5939c3 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:41.414940 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953f3e8-cc63-4269-b922-346d537d1449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:41.415720 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953f3e8-cc63-4269-b922-346d537d1449 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:41.416021 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953f3e8-cc63-4269-b922-346d537d1449 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:41.416304 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953f3e8-cc63-4269-b922-346d537d1449 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:41.460270 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:41.527727 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953f3e8-cc63-4269-b922-346d537d1449 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:41.529605 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953f3e8-cc63-4269-b922-346d537d1449 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:41.693978 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 414/835] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:05:41 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 15:05:41.701705 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5906258-9a4f-4f3d-b615-f2c9b2f9a1dd None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:41.738325 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:41.859502 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5906258-9a4f-4f3d-b615-f2c9b2f9a1dd None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:41.900652 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bb93b-7362-439b-a284-cef9fe6f4da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:41.901533 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bb93b-7362-439b-a284-cef9fe6f4da4 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:41.901930 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bb93b-7362-439b-a284-cef9fe6f4da4 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:41.902276 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bb93b-7362-439b-a284-cef9fe6f4da4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:41.915805 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3bb93b-7362-439b-a284-cef9fe6f4da4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:41.918679 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3bb93b-7362-439b-a284-cef9fe6f4da4 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:41.945460 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-ae3bb93b-7362-439b-a284-cef9fe6f4da4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:05:41.945460 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:05:41.945460 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:05:41.945460 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:05:41.945460 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:05:41.945460 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:05:41.945460 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:05:41.945460 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:05:41.945460 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:05:41.945460 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:05:41.945460 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:05:41.945460 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:05:41.945460 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:05:41.945460 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:05:41.945460 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:05:41.947259 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:05:41.947259 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:05:41.947259 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:05:41.947259 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:05:41.947259 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:05:41.947259 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:05:41.947259 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:05:41.947259 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:05:41.947259 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:05:41.947259 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:05:41.947259 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:05:41.947259 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:05:41.947259 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:05:41.947259 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:05:41.947259 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:05:41.947259 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:05:41.947259 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:05:41.949066 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:05:41.949066 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:05:41.949066 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:05:41.949066 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:05:41.949066 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 422/836] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:05:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:05:41.955689 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953f3e8-cc63-4269-b922-346d537d1449 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:42.041029 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:42.115754 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953f3e8-cc63-4269-b922-346d537d1449 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:42.174256 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139d18b-8894-4d19-98f3-b88777c355e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:42.175194 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139d18b-8894-4d19-98f3-b88777c355e4 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:42.175615 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139d18b-8894-4d19-98f3-b88777c355e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:42.176043 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139d18b-8894-4d19-98f3-b88777c355e4 None admin] PATH_INFO: `/v3/domains` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:42.177002 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139d18b-8894-4d19-98f3-b88777c355e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:42.177405 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139d18b-8894-4d19-98f3-b88777c355e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:42.179674 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139d18b-8894-4d19-98f3-b88777c355e4 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:42.195605 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 415/837] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:05:42.204744 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bb93b-7362-439b-a284-cef9fe6f4da4 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:42.313023 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:42.359069 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bb93b-7362-439b-a284-cef9fe6f4da4 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:42.409765 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa84e36-8686-41a2-bab7-67f03c3a0c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:42.410936 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa84e36-8686-41a2-bab7-67f03c3a0c26 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:42.411430 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa84e36-8686-41a2-bab7-67f03c3a0c26 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:42.411819 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa84e36-8686-41a2-bab7-67f03c3a0c26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:42.423018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa84e36-8686-41a2-bab7-67f03c3a0c26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:42.424813 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa84e36-8686-41a2-bab7-67f03c3a0c26 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:42.450149 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-9fa84e36-8686-41a2-bab7-67f03c3a0c26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:05:42.450149 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:05:42.450149 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:05:42.450149 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:05:42.450149 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:05:42.450149 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:05:42.450149 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:05:42.450149 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:05:42.450149 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:05:42.450149 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:05:42.450149 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:05:42.450149 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:05:42.450149 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:05:42.450149 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:05:42.450149 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:05:42.452026 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:05:42.452026 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:05:42.452026 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:05:42.452026 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:05:42.452026 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:05:42.452026 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:05:42.452026 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:05:42.452026 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:05:42.452026 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:05:42.452026 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:05:42.452026 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:05:42.452026 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:05:42.452026 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:05:42.452026 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:05:42.452026 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:05:42.452026 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:05:42.452026 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:05:42.453888 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:05:42.453888 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:05:42.453888 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:05:42.453888 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:05:42.453888 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:05:42.453888 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:05:42.453888 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:05:42.453888 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:05:42.453888 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 423/838] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:05:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:05:42.461603 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139d18b-8894-4d19-98f3-b88777c355e4 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:42.620177 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139d18b-8894-4d19-98f3-b88777c355e4 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:42.649294 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:42.674449 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6d6ba-92ac-4b46-9177-2f1af8ed1267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:42.675305 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6d6ba-92ac-4b46-9177-2f1af8ed1267 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:42.675702 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6d6ba-92ac-4b46-9177-2f1af8ed1267 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:42.676133 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6d6ba-92ac-4b46-9177-2f1af8ed1267 None admin] PATH_INFO: `/v3/projects` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:42.677047 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6d6ba-92ac-4b46-9177-2f1af8ed1267 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:42.677483 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6d6ba-92ac-4b46-9177-2f1af8ed1267 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:42.679249 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6d6ba-92ac-4b46-9177-2f1af8ed1267 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:42.697994 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 416/839] 10.222.0.39 () {56 vars in 1148 bytes} [Wed May 25 15:05:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:05:42.704787 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa84e36-8686-41a2-bab7-67f03c3a0c26 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:42.862980 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa84e36-8686-41a2-bab7-67f03c3a0c26 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:42.894781 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:42.901844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20d987-a069-40ba-8de3-f275b5f002b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:42.902616 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20d987-a069-40ba-8de3-f275b5f002b6 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:42.902898 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20d987-a069-40ba-8de3-f275b5f002b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:42.903181 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20d987-a069-40ba-8de3-f275b5f002b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:42.904123 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20d987-a069-40ba-8de3-f275b5f002b6 None admin] RBAC: Adding query filter params (role.id=eecb3a0cafcf49b5898e1ca834e110aa, scope.project.id=ff4afc67ebcf4840946ce41755f94bf0, user.id=b28b47418d054fe091d379d83a30db11) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:42.904833 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20d987-a069-40ba-8de3-f275b5f002b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:42.908399 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20d987-a069-40ba-8de3-f275b5f002b6 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:42.920813 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 424/840] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:05:42 2022] GET /identity/v3/role_assignments?user.id=b28b47418d054fe091d379d83a30db11&scope.project.id=ff4afc67ebcf4840946ce41755f94bf0&role.id=eecb3a0cafcf49b5898e1ca834e110aa => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:05:45.319182 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd35bd-bd22-4740-ae19-22c95c24e5be None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:45.320039 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd35bd-bd22-4740-ae19-22c95c24e5be None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:45.320039 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd35bd-bd22-4740-ae19-22c95c24e5be None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:45.321132 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 417/841] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:05:45.327345 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d93ce-02db-4132-840f-68a52876e6eb None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:45.328112 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d93ce-02db-4132-840f-68a52876e6eb None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:45.328112 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d93ce-02db-4132-840f-68a52876e6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:45.347956 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-143d93ce-02db-4132-840f-68a52876e6eb None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:45.349386 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-143d93ce-02db-4132-840f-68a52876e6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:45.438229 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 425/842] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:05:45 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:05:45.461598 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd35bd-bd22-4740-ae19-22c95c24e5be None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:45.589877 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd35bd-bd22-4740-ae19-22c95c24e5be None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:45.631099 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02440dc-a382-4092-ae5a-1068f20b1de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:45.631940 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02440dc-a382-4092-ae5a-1068f20b1de6 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:45.632198 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02440dc-a382-4092-ae5a-1068f20b1de6 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:45.632475 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02440dc-a382-4092-ae5a-1068f20b1de6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:45.645302 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02440dc-a382-4092-ae5a-1068f20b1de6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:05:45.653581 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-f02440dc-a382-4092-ae5a-1068f20b1de6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:05:45.653581 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:05:45.653581 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:05:45.653581 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:05:45.653581 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:05:45.653581 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:05:45.653581 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:05:45.653581 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:05:45.653581 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:05:45.653581 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:05:45.653581 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:05:45.653581 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:05:45.653581 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:05:45.653581 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:05:45.653581 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:05:45.653581 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:05:45.655335 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:05:45.655335 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:05:45.655335 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:05:45.655335 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:05:45.655335 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:05:45.655335 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:05:45.655335 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:05:45.655335 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:05:45.655335 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:05:45.655335 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:05:45.655335 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:05:45.655335 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:05:45.655335 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:05:45.655335 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:05:45.655335 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:05:45.655335 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:05:45.656280 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:05:45.656280 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:05:45.656280 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:05:45.656280 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:05:45.656280 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:05:45.656280 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:05:45.656280 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:05:45.656280 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:05:45.656280 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:05:45.656280 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:05:45.656280 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:05:45.656280 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:05:45.656280 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 418/843] 10.222.0.39 () {56 vars in 1102 bytes} [Wed May 25 15:05:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:05:45.661728 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d93ce-02db-4132-840f-68a52876e6eb None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:45.803315 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d93ce-02db-4132-840f-68a52876e6eb None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:45.836639 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:45.851477 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cbeaa-831a-4cd4-90e2-3ac8c216fba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:45.852541 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cbeaa-831a-4cd4-90e2-3ac8c216fba5 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:45.853011 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cbeaa-831a-4cd4-90e2-3ac8c216fba5 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:45.853422 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cbeaa-831a-4cd4-90e2-3ac8c216fba5 None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:45.854374 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3cbeaa-831a-4cd4-90e2-3ac8c216fba5 None admin] RBAC: Adding query filter params (name=service) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:45.854762 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3cbeaa-831a-4cd4-90e2-3ac8c216fba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:45.856252 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3cbeaa-831a-4cd4-90e2-3ac8c216fba5 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:45.868403 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 426/844] 10.222.0.39 () {56 vars in 1103 bytes} [Wed May 25 15:05:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:05:45.878051 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02440dc-a382-4092-ae5a-1068f20b1de6 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:45.935473 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:46.031491 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02440dc-a382-4092-ae5a-1068f20b1de6 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:46.087519 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b50cc4-6f75-4954-b44d-1854d9b8e11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:46.088543 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b50cc4-6f75-4954-b44d-1854d9b8e11a None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:46.088935 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b50cc4-6f75-4954-b44d-1854d9b8e11a None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:46.089397 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b50cc4-6f75-4954-b44d-1854d9b8e11a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:46.110218 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b50cc4-6f75-4954-b44d-1854d9b8e11a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:46.112826 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b50cc4-6f75-4954-b44d-1854d9b8e11a None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:46.139978 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-39b50cc4-6f75-4954-b44d-1854d9b8e11a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:05:46.139978 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:05:46.139978 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:05:46.139978 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:05:46.139978 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:05:46.139978 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:05:46.139978 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:05:46.139978 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:05:46.139978 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:05:46.139978 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:05:46.139978 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:05:46.139978 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:05:46.139978 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:05:46.139978 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:05:46.139978 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:05:46.141875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:05:46.141875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:05:46.141875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:05:46.141875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:05:46.141875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:05:46.141875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:05:46.141875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:05:46.141875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:05:46.141875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:05:46.141875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:05:46.141875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:05:46.141875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:05:46.141875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:05:46.141875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:05:46.141875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:05:46.141875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:05:46.141875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:05:46.143785 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:05:46.143785 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:05:46.143785 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:05:46.143785 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:05:46.143785 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 419/845] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:05:46.148286 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cbeaa-831a-4cd4-90e2-3ac8c216fba5 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:46.308081 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cbeaa-831a-4cd4-90e2-3ac8c216fba5 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:46.354405 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cd2ce-7cbc-4b97-a603-a46ed24ec78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:46.355529 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cd2ce-7cbc-4b97-a603-a46ed24ec78d None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:46.355924 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cd2ce-7cbc-4b97-a603-a46ed24ec78d None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:46.356310 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cd2ce-7cbc-4b97-a603-a46ed24ec78d None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:46.357455 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cd2ce-7cbc-4b97-a603-a46ed24ec78d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:46.357960 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cd2ce-7cbc-4b97-a603-a46ed24ec78d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:46.360102 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cd2ce-7cbc-4b97-a603-a46ed24ec78d None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:46.375130 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 427/846] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:05:46.381943 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b50cc4-6f75-4954-b44d-1854d9b8e11a None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:46.536797 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:46.554883 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b50cc4-6f75-4954-b44d-1854d9b8e11a None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:46.610325 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea41a5-6ed8-4688-a0e0-a555da2cf1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:46.611663 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea41a5-6ed8-4688-a0e0-a555da2cf1e6 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:46.612029 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea41a5-6ed8-4688-a0e0-a555da2cf1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:46.612578 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea41a5-6ed8-4688-a0e0-a555da2cf1e6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:46.624949 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea41a5-6ed8-4688-a0e0-a555da2cf1e6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:46.627914 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea41a5-6ed8-4688-a0e0-a555da2cf1e6 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:46.649626 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-28ea41a5-6ed8-4688-a0e0-a555da2cf1e6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 15:05:46.649626 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:05:46.649626 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:05:46.649626 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:05:46.649626 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:05:46.649626 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:05:46.649626 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:05:46.649626 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:05:46.649626 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:05:46.649626 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:05:46.649626 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:05:46.649626 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:05:46.649626 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:05:46.649626 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:05:46.649626 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:05:46.649626 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:05:46.651951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:05:46.651951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:05:46.651951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:05:46.651951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:05:46.651951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:05:46.651951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:05:46.651951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:05:46.651951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:05:46.651951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:05:46.651951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:05:46.651951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:05:46.651951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:05:46.651951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:05:46.651951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:05:46.651951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:05:46.651951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:05:46.651951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:05:46.651951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:05:46.654161 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:05:46.654161 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:05:46.654161 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:05:46.654161 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:05:46.654161 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:05:46.654161 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:05:46.654161 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:05:46.654161 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:05:46.654161 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 15:05:46.654161 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:05:46.654161 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 420/847] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:05:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:05:46.660001 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cd2ce-7cbc-4b97-a603-a46ed24ec78d None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:46.740123 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:46.831743 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cd2ce-7cbc-4b97-a603-a46ed24ec78d None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:46.881674 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd6976-aa73-432e-87bb-3a742e04cc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:46.882666 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd6976-aa73-432e-87bb-3a742e04cc68 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:46.883174 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd6976-aa73-432e-87bb-3a742e04cc68 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:46.883598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd6976-aa73-432e-87bb-3a742e04cc68 None admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:46.884869 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd6976-aa73-432e-87bb-3a742e04cc68 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:46.885311 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd6976-aa73-432e-87bb-3a742e04cc68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:46.887209 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd6976-aa73-432e-87bb-3a742e04cc68 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:46.913321 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 428/848] 10.222.0.39 () {56 vars in 1143 bytes} [Wed May 25 15:05:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:05:46.920941 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea41a5-6ed8-4688-a0e0-a555da2cf1e6 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:47.063747 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea41a5-6ed8-4688-a0e0-a555da2cf1e6 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:47.133822 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efbd90-6b05-4c7a-873e-0ea9bd91c9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:47.135398 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efbd90-6b05-4c7a-873e-0ea9bd91c9a9 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:47.135822 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efbd90-6b05-4c7a-873e-0ea9bd91c9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:47.136196 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efbd90-6b05-4c7a-873e-0ea9bd91c9a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:47.154381 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6efbd90-6b05-4c7a-873e-0ea9bd91c9a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:47.156527 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6efbd90-6b05-4c7a-873e-0ea9bd91c9a9 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:47.185218 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-b6efbd90-6b05-4c7a-873e-0ea9bd91c9a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:05:47.185218 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:05:47.185218 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:05:47.185218 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:05:47.185218 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:05:47.185218 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:05:47.185218 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:05:47.185218 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:05:47.185218 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:05:47.185218 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:05:47.185218 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:05:47.185218 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:05:47.185218 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:05:47.185218 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:05:47.185218 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:05:47.187314 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:05:47.187314 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:05:47.187314 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:05:47.187314 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:05:47.187314 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:05:47.187314 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:05:47.187314 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:05:47.187314 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:05:47.187314 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:05:47.187314 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:05:47.187314 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:05:47.187314 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:05:47.187314 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:05:47.187314 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:05:47.187314 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:05:47.187314 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:05:47.187314 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:05:47.188405 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:05:47.188405 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:05:47.188405 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:05:47.188405 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:05:47.188405 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 421/849] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:05:47.193693 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd6976-aa73-432e-87bb-3a742e04cc68 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:47.353164 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd6976-aa73-432e-87bb-3a742e04cc68 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:47.356109 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:47.403141 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a34c10-03b8-4650-ac49-0595f498f968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:47.405374 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a34c10-03b8-4650-ac49-0595f498f968 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:47.405955 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a34c10-03b8-4650-ac49-0595f498f968 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:47.406539 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a34c10-03b8-4650-ac49-0595f498f968 None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:47.411012 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a34c10-03b8-4650-ac49-0595f498f968 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:47.411012 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a34c10-03b8-4650-ac49-0595f498f968 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:47.411012 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a34c10-03b8-4650-ac49-0595f498f968 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:47.436035 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 429/850] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:05:47.445972 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efbd90-6b05-4c7a-873e-0ea9bd91c9a9 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:47.449710 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:47.623372 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efbd90-6b05-4c7a-873e-0ea9bd91c9a9 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:47.666150 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9fd35d-9acf-434b-8493-dfa7d4d7f491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:47.666926 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fd35d-9acf-434b-8493-dfa7d4d7f491 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:47.667211 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fd35d-9acf-434b-8493-dfa7d4d7f491 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:47.667487 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9fd35d-9acf-434b-8493-dfa7d4d7f491 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:47.675834 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9fd35d-9acf-434b-8493-dfa7d4d7f491 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:47.677533 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9fd35d-9acf-434b-8493-dfa7d4d7f491 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:47.704712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-7e9fd35d-9acf-434b-8493-dfa7d4d7f491 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:05:47.704712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:05:47.704712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:05:47.704712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:05:47.704712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:05:47.704712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:05:47.704712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:05:47.704712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:05:47.704712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:05:47.704712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:05:47.704712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:05:47.704712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:05:47.704712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:05:47.704712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:05:47.704712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:05:47.706598 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:05:47.706598 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:05:47.706598 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:05:47.706598 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:05:47.706598 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:05:47.706598 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:05:47.706598 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:05:47.706598 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:05:47.706598 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:05:47.706598 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:05:47.706598 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:05:47.706598 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:05:47.706598 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:05:47.706598 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:05:47.706598 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:05:47.706598 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:05:47.706598 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:05:47.708416 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:05:47.708416 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:05:47.708416 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:05:47.708416 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:05:47.708416 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:05:47.708416 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:05:47.708416 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:05:47.708416 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:05:47.708416 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 422/851] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:05:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:05:47.717600 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a34c10-03b8-4650-ac49-0595f498f968 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:47.891092 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a34c10-03b8-4650-ac49-0595f498f968 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:47.943313 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7129e7-0943-4a70-9808-5404da35dd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:47.944134 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7129e7-0943-4a70-9808-5404da35dd46 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:47.944509 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7129e7-0943-4a70-9808-5404da35dd46 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:47.944896 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7129e7-0943-4a70-9808-5404da35dd46 None admin] PATH_INFO: `/v3/projects` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:47.946012 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7129e7-0943-4a70-9808-5404da35dd46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:47.946485 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7129e7-0943-4a70-9808-5404da35dd46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:47.948376 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7129e7-0943-4a70-9808-5404da35dd46 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:47.967136 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 430/852] 10.222.0.39 () {56 vars in 1148 bytes} [Wed May 25 15:05:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:05:47.974741 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9fd35d-9acf-434b-8493-dfa7d4d7f491 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:48.066880 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:48.127945 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9fd35d-9acf-434b-8493-dfa7d4d7f491 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:48.179126 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615c557-f505-4977-bd4e-3ec976d348cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:48.180192 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615c557-f505-4977-bd4e-3ec976d348cd None admin] REQUEST_METHOD: `PUT` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:48.180586 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615c557-f505-4977-bd4e-3ec976d348cd None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:48.180793 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615c557-f505-4977-bd4e-3ec976d348cd None admin] PATH_INFO: `/v3/projects/ff4afc67ebcf4840946ce41755f94bf0/users/b28b47418d054fe091d379d83a30db11/roles/eecb3a0cafcf49b5898e1ca834e110aa` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:48.204594 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615c557-f505-4977-bd4e-3ec976d348cd None admin] RBAC: Authorizing `identity:create_grant(project_id=ff4afc67ebcf4840946ce41755f94bf0, user_id=b28b47418d054fe091d379d83a30db11, role_id=eecb3a0cafcf49b5898e1ca834e110aa)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:48.207127 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615c557-f505-4977-bd4e-3ec976d348cd None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:48.225180 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 423/853] 10.222.0.39 () {58 vars in 1439 bytes} [Wed May 25 15:05:47 2022] PUT /identity/v3/projects/ff4afc67ebcf4840946ce41755f94bf0/users/b28b47418d054fe091d379d83a30db11/roles/eecb3a0cafcf49b5898e1ca834e110aa => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:05:50.734824 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd87ce-5737-42d5-9b8f-f33315a7cdfd None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:50.735660 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd87ce-5737-42d5-9b8f-f33315a7cdfd None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:50.735660 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd87ce-5737-42d5-9b8f-f33315a7cdfd None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:50.736723 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 431/854] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:05:50.747611 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9f895-eeab-48ba-9d66-35a3f856f3e9 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:50.748197 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9f895-eeab-48ba-9d66-35a3f856f3e9 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:50.748574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9f895-eeab-48ba-9d66-35a3f856f3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:50.777463 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-66e9f895-eeab-48ba-9d66-35a3f856f3e9 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:50.779904 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-66e9f895-eeab-48ba-9d66-35a3f856f3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:50.884954 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 424/855] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:05:50 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:05:50.930515 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd87ce-5737-42d5-9b8f-f33315a7cdfd None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:50.971861 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:51.090374 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd87ce-5737-42d5-9b8f-f33315a7cdfd None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:51.149096 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abf2d0-c659-44a0-ad29-fe91b68a34b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:51.150536 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abf2d0-c659-44a0-ad29-fe91b68a34b0 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:51.151034 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abf2d0-c659-44a0-ad29-fe91b68a34b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:51.151558 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abf2d0-c659-44a0-ad29-fe91b68a34b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:51.164900 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59abf2d0-c659-44a0-ad29-fe91b68a34b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:05:51.174096 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-59abf2d0-c659-44a0-ad29-fe91b68a34b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:05:51.174096 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:05:51.174096 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:05:51.174096 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:05:51.174096 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:05:51.174096 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:05:51.174096 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:05:51.174096 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:05:51.174096 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:05:51.174096 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:05:51.174096 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:05:51.174096 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:05:51.174096 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:05:51.174096 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:05:51.174096 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:05:51.174096 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:05:51.176274 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:05:51.176274 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:05:51.176274 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:05:51.176274 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:05:51.176274 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:05:51.176274 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:05:51.176274 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:05:51.176274 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:05:51.176274 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:05:51.176274 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:05:51.176274 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:05:51.176274 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:05:51.176274 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:05:51.176274 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:05:51.176274 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:05:51.176274 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:05:51.177976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:05:51.177976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:05:51.177976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:05:51.177976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:05:51.177976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:05:51.177976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:05:51.177976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:05:51.177976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:05:51.177976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:05:51.177976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:05:51.177976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:05:51.177976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:05:51.177976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 432/856] 10.222.0.39 () {56 vars in 1102 bytes} [Wed May 25 15:05:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:05:51.185699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9f895-eeab-48ba-9d66-35a3f856f3e9 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:51.258446 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:51.349146 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9f895-eeab-48ba-9d66-35a3f856f3e9 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:51.403763 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cacbb8-5f89-4536-b9b4-311b63e055b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:51.404747 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cacbb8-5f89-4536-b9b4-311b63e055b9 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:51.405188 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cacbb8-5f89-4536-b9b4-311b63e055b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:51.405599 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cacbb8-5f89-4536-b9b4-311b63e055b9 None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:51.406681 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cacbb8-5f89-4536-b9b4-311b63e055b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:51.407239 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cacbb8-5f89-4536-b9b4-311b63e055b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:51.409218 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cacbb8-5f89-4536-b9b4-311b63e055b9 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:51.421344 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 425/857] 10.222.0.39 () {56 vars in 1103 bytes} [Wed May 25 15:05:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:05:51.428978 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abf2d0-c659-44a0-ad29-fe91b68a34b0 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:51.563815 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:51.587448 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abf2d0-c659-44a0-ad29-fe91b68a34b0 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:51.635083 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a1aaf-1d55-4833-8049-29bec1573bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:51.635981 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a1aaf-1d55-4833-8049-29bec1573bb3 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:51.636318 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a1aaf-1d55-4833-8049-29bec1573bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:51.636732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a1aaf-1d55-4833-8049-29bec1573bb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:51.651561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a1aaf-1d55-4833-8049-29bec1573bb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:51.655143 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a1aaf-1d55-4833-8049-29bec1573bb3 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:51.679220 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-734a1aaf-1d55-4833-8049-29bec1573bb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:05:51.679220 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:05:51.679220 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:05:51.679220 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:05:51.679220 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:05:51.679220 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:05:51.679220 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:05:51.679220 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:05:51.679220 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:05:51.679220 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:05:51.679220 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:05:51.679220 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:05:51.679220 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:05:51.679220 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:05:51.679220 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:05:51.680416 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:05:51.680416 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:05:51.680416 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:05:51.680416 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:05:51.680416 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:05:51.680416 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:05:51.680416 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:05:51.680416 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:05:51.680416 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:05:51.680416 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:05:51.680416 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:05:51.680416 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:05:51.680416 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:05:51.680416 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:05:51.680416 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:05:51.680416 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:05:51.680416 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:05:51.681822 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:05:51.681822 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:05:51.681822 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:05:51.681822 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:05:51.681822 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 433/858] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:05:51.690660 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cacbb8-5f89-4536-b9b4-311b63e055b9 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:51.846833 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cacbb8-5f89-4536-b9b4-311b63e055b9 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:51.850560 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:51.900393 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd74542-6983-4e32-b93c-5d09d6a043e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:51.901422 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd74542-6983-4e32-b93c-5d09d6a043e9 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:51.902013 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd74542-6983-4e32-b93c-5d09d6a043e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:51.902519 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd74542-6983-4e32-b93c-5d09d6a043e9 None admin] PATH_INFO: `/v3/domains` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:51.904488 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd74542-6983-4e32-b93c-5d09d6a043e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:51.904723 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd74542-6983-4e32-b93c-5d09d6a043e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:51.907189 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd74542-6983-4e32-b93c-5d09d6a043e9 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:51.927873 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 426/859] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:05:51.934438 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a1aaf-1d55-4833-8049-29bec1573bb3 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:52.086013 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a1aaf-1d55-4833-8049-29bec1573bb3 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:52.141485 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2e7b9-6e87-4b69-a2eb-45c55787557f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:52.143091 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2e7b9-6e87-4b69-a2eb-45c55787557f None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:52.143659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2e7b9-6e87-4b69-a2eb-45c55787557f None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:52.144147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2e7b9-6e87-4b69-a2eb-45c55787557f None admin] PATH_INFO: `/v3/users/placement` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:52.149680 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:52.158966 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2e7b9-6e87-4b69-a2eb-45c55787557f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:52.159378 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2e7b9-6e87-4b69-a2eb-45c55787557f None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:52.177079 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-2af2e7b9-6e87-4b69-a2eb-45c55787557f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 15:05:52.177079 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:05:52.177079 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:05:52.177079 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:05:52.177079 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:05:52.177079 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:05:52.177079 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:05:52.177079 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:05:52.177079 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:05:52.177079 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:05:52.177079 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:05:52.177079 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:05:52.177079 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:05:52.177079 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:05:52.177079 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:05:52.177079 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:05:52.179496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:05:52.179496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:05:52.179496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:05:52.179496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:05:52.179496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:05:52.179496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:05:52.179496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:05:52.179496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:05:52.179496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:05:52.179496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:05:52.179496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:05:52.179496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:05:52.179496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:05:52.179496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:05:52.179496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:05:52.179496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:05:52.179496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:05:52.179496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:05:52.180728 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:05:52.180728 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:05:52.180728 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:05:52.180728 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:05:52.180728 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:05:52.180728 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:05:52.180728 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:05:52.180728 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:05:52.180728 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 15:05:52.180728 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:05:52.180728 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 434/860] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:05:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:05:52.185889 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd74542-6983-4e32-b93c-5d09d6a043e9 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:52.342097 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd74542-6983-4e32-b93c-5d09d6a043e9 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:52.397843 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec9c63-acf3-446d-b82f-70ca92351f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:52.398616 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec9c63-acf3-446d-b82f-70ca92351f61 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:52.398901 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec9c63-acf3-446d-b82f-70ca92351f61 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:52.399180 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec9c63-acf3-446d-b82f-70ca92351f61 None admin] PATH_INFO: `/v3/users` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:52.400059 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec9c63-acf3-446d-b82f-70ca92351f61 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:52.400402 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec9c63-acf3-446d-b82f-70ca92351f61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:52.401982 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec9c63-acf3-446d-b82f-70ca92351f61 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:52.426831 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 427/861] 10.222.0.39 () {56 vars in 1143 bytes} [Wed May 25 15:05:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:05:52.433182 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2e7b9-6e87-4b69-a2eb-45c55787557f None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:52.608491 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2e7b9-6e87-4b69-a2eb-45c55787557f None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:52.667109 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85f713-804c-44c4-b575-7ffbd1aa101e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:52.667972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85f713-804c-44c4-b575-7ffbd1aa101e None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:52.668376 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85f713-804c-44c4-b575-7ffbd1aa101e None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:52.668796 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85f713-804c-44c4-b575-7ffbd1aa101e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:52.769832 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:52.785426 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85f713-804c-44c4-b575-7ffbd1aa101e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:52.787824 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85f713-804c-44c4-b575-7ffbd1aa101e None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:52.951796 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 435/862] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:05:52 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 15:05:52.958741 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec9c63-acf3-446d-b82f-70ca92351f61 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:52.997081 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:53.147332 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec9c63-acf3-446d-b82f-70ca92351f61 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:53.210436 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8df7c2-be05-4a2a-a262-f5f32de9c828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:53.211498 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8df7c2-be05-4a2a-a262-f5f32de9c828 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:53.211883 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8df7c2-be05-4a2a-a262-f5f32de9c828 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:53.212254 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8df7c2-be05-4a2a-a262-f5f32de9c828 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:53.225313 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8df7c2-be05-4a2a-a262-f5f32de9c828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:53.226994 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8df7c2-be05-4a2a-a262-f5f32de9c828 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:53.249078 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-9d8df7c2-be05-4a2a-a262-f5f32de9c828 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:05:53.249078 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:05:53.249078 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:05:53.249078 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:05:53.249078 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:05:53.249078 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:05:53.249078 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:05:53.249078 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:05:53.249078 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:05:53.249078 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:05:53.249078 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:05:53.249078 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:05:53.249078 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:05:53.249078 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:05:53.249078 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:05:53.255951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:05:53.255951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:05:53.255951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:05:53.255951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:05:53.255951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:05:53.255951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:05:53.255951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:05:53.255951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:05:53.255951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:05:53.255951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:05:53.255951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:05:53.255951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:05:53.255951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:05:53.255951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:05:53.255951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:05:53.255951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:05:53.255951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:05:53.257964 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:05:53.257964 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:05:53.257964 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:05:53.257964 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:05:53.257964 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 428/863] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:05:53.258685 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85f713-804c-44c4-b575-7ffbd1aa101e None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:53.396389 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:53.404747 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85f713-804c-44c4-b575-7ffbd1aa101e None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:53.449834 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb6914-0c8e-4bef-8d16-00b469a76a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:53.450986 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb6914-0c8e-4bef-8d16-00b469a76a90 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:53.451407 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb6914-0c8e-4bef-8d16-00b469a76a90 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:53.451725 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb6914-0c8e-4bef-8d16-00b469a76a90 None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:53.452665 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb6914-0c8e-4bef-8d16-00b469a76a90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:53.452990 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb6914-0c8e-4bef-8d16-00b469a76a90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:53.454544 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb6914-0c8e-4bef-8d16-00b469a76a90 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:53.473077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 436/864] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:05:53.480855 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8df7c2-be05-4a2a-a262-f5f32de9c828 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:53.597098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:53.652528 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8df7c2-be05-4a2a-a262-f5f32de9c828 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:53.712792 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6199a27-3749-457d-b395-83532f96ad6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:53.714029 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6199a27-3749-457d-b395-83532f96ad6c None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:53.714508 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6199a27-3749-457d-b395-83532f96ad6c None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:53.714957 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6199a27-3749-457d-b395-83532f96ad6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:53.727761 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6199a27-3749-457d-b395-83532f96ad6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:53.730434 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6199a27-3749-457d-b395-83532f96ad6c None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:53.756763 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-c6199a27-3749-457d-b395-83532f96ad6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:05:53.756763 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:05:53.756763 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:05:53.756763 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:05:53.756763 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:05:53.756763 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:05:53.756763 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:05:53.756763 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:05:53.756763 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:05:53.756763 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:05:53.756763 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:05:53.756763 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:05:53.756763 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:05:53.756763 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:05:53.756763 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:05:53.759127 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:05:53.759127 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:05:53.759127 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:05:53.759127 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:05:53.759127 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:05:53.759127 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:05:53.759127 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:05:53.759127 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:05:53.759127 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:05:53.759127 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:05:53.759127 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:05:53.759127 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:05:53.759127 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:05:53.759127 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:05:53.759127 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:05:53.759127 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:05:53.759127 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:05:53.761445 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:05:53.761445 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:05:53.761445 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:05:53.761445 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:05:53.761445 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:05:53.761445 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:05:53.761445 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:05:53.761445 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:05:53.761445 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 429/865] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:05:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:05:53.767389 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb6914-0c8e-4bef-8d16-00b469a76a90 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:53.921051 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb6914-0c8e-4bef-8d16-00b469a76a90 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:53.987861 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37166c26-5d82-4cfc-8ff1-9ff0d8794bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:53.988654 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37166c26-5d82-4cfc-8ff1-9ff0d8794bdc None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:53.988930 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37166c26-5d82-4cfc-8ff1-9ff0d8794bdc None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:53.989207 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37166c26-5d82-4cfc-8ff1-9ff0d8794bdc None admin] PATH_INFO: `/v3/projects` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:53.990319 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37166c26-5d82-4cfc-8ff1-9ff0d8794bdc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:53.990636 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37166c26-5d82-4cfc-8ff1-9ff0d8794bdc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:53.992129 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37166c26-5d82-4cfc-8ff1-9ff0d8794bdc None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:54.010599 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 437/866] 10.222.0.39 () {56 vars in 1148 bytes} [Wed May 25 15:05:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:05:54.017990 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6199a27-3749-457d-b395-83532f96ad6c None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:54.179236 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6199a27-3749-457d-b395-83532f96ad6c None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:54.236572 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade8c61-381f-4f2c-987d-409f55e13b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:54.237668 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade8c61-381f-4f2c-987d-409f55e13b9c None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:54.238218 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade8c61-381f-4f2c-987d-409f55e13b9c None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:54.238639 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade8c61-381f-4f2c-987d-409f55e13b9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:54.239880 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade8c61-381f-4f2c-987d-409f55e13b9c None admin] RBAC: Adding query filter params (role.id=eecb3a0cafcf49b5898e1ca834e110aa, scope.project.id=ff4afc67ebcf4840946ce41755f94bf0, user.id=b28b47418d054fe091d379d83a30db11) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:54.240424 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade8c61-381f-4f2c-987d-409f55e13b9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:54.242646 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ade8c61-381f-4f2c-987d-409f55e13b9c None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:54.245364 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:54.260046 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 430/867] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:05:54 2022] GET /identity/v3/role_assignments?user.id=b28b47418d054fe091d379d83a30db11&scope.project.id=ff4afc67ebcf4840946ce41755f94bf0&role.id=eecb3a0cafcf49b5898e1ca834e110aa => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:05:57.189489 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28238360-0b37-4ef3-9df6-cf31239b53cc None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:57.190167 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28238360-0b37-4ef3-9df6-cf31239b53cc None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:57.190167 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28238360-0b37-4ef3-9df6-cf31239b53cc None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:57.191503 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 438/868] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:05:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:05:57.200496 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa26b4-359b-43e3-b9f9-33f4d78d5822 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:57.201213 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa26b4-359b-43e3-b9f9-33f4d78d5822 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:57.201792 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa26b4-359b-43e3-b9f9-33f4d78d5822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:57.236116 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-c6fa26b4-359b-43e3-b9f9-33f4d78d5822 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:05:57.237604 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-c6fa26b4-359b-43e3-b9f9-33f4d78d5822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:05:57.353991 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 431/869] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:05:57 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:05:57.386064 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28238360-0b37-4ef3-9df6-cf31239b53cc None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:57.416713 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:57.550652 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28238360-0b37-4ef3-9df6-cf31239b53cc None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:57.594860 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3796545-fd6f-4633-bd67-19791b0c9639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:57.595695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3796545-fd6f-4633-bd67-19791b0c9639 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:57.596003 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3796545-fd6f-4633-bd67-19791b0c9639 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:57.596276 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3796545-fd6f-4633-bd67-19791b0c9639 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:57.608897 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3796545-fd6f-4633-bd67-19791b0c9639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:05:57.617359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-a3796545-fd6f-4633-bd67-19791b0c9639 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:05:57.617359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:05:57.617359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:05:57.617359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:05:57.617359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:05:57.617359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:05:57.617359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:05:57.617359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:05:57.617359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:05:57.617359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:05:57.617359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:05:57.617359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:05:57.617359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:05:57.617359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:05:57.617359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:05:57.617359 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:05:57.619352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:05:57.619352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:05:57.619352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:05:57.619352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:05:57.619352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:05:57.619352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:05:57.619352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:05:57.619352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:05:57.619352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:05:57.619352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:05:57.619352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:05:57.619352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:05:57.619352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:05:57.619352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:05:57.619352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:05:57.619352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:05:57.621100 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:05:57.621100 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:05:57.621100 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:05:57.621100 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:05:57.621100 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:05:57.621100 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:05:57.621100 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:05:57.621100 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:05:57.621100 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:05:57.621100 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:05:57.621100 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:05:57.621100 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:05:57.624044 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 439/870] 10.222.0.39 () {56 vars in 1096 bytes} [Wed May 25 15:05:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:05:57.625609 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa26b4-359b-43e3-b9f9-33f4d78d5822 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:57.780790 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa26b4-359b-43e3-b9f9-33f4d78d5822 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:57.822558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:57.835803 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71d0b8-c9e3-4de0-af8f-7d19c44ccbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:57.836840 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71d0b8-c9e3-4de0-af8f-7d19c44ccbf0 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:57.837535 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71d0b8-c9e3-4de0-af8f-7d19c44ccbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:57.837974 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71d0b8-c9e3-4de0-af8f-7d19c44ccbf0 None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:57.839392 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71d0b8-c9e3-4de0-af8f-7d19c44ccbf0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:57.840002 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71d0b8-c9e3-4de0-af8f-7d19c44ccbf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:57.842666 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71d0b8-c9e3-4de0-af8f-7d19c44ccbf0 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:57.856055 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 432/871] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:05:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:05:57.864079 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3796545-fd6f-4633-bd67-19791b0c9639 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:57.975747 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:58.015775 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3796545-fd6f-4633-bd67-19791b0c9639 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:58.076763 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e011f3-486c-47de-8829-d3db24e3c1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:58.077932 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e011f3-486c-47de-8829-d3db24e3c1d7 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:58.078420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e011f3-486c-47de-8829-d3db24e3c1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:58.078856 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e011f3-486c-47de-8829-d3db24e3c1d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:58.097560 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e011f3-486c-47de-8829-d3db24e3c1d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:58.100632 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e011f3-486c-47de-8829-d3db24e3c1d7 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:58.131795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-83e011f3-486c-47de-8829-d3db24e3c1d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:05:58.131795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:05:58.131795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:05:58.131795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:05:58.131795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:05:58.131795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:05:58.131795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:05:58.131795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:05:58.131795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:05:58.131795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:05:58.131795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:05:58.131795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:05:58.131795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:05:58.131795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:05:58.131795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:05:58.133572 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:05:58.133572 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:05:58.133572 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:05:58.133572 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:05:58.133572 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:05:58.133572 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:05:58.133572 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:05:58.133572 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:05:58.133572 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:05:58.133572 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:05:58.133572 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:05:58.133572 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:05:58.133572 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:05:58.133572 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:05:58.133572 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:05:58.133572 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:05:58.133572 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:05:58.135130 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:05:58.135130 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:05:58.135130 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:05:58.135130 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:05:58.142135 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 440/872] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:05:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:05:58.144011 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71d0b8-c9e3-4de0-af8f-7d19c44ccbf0 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:58.315561 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71d0b8-c9e3-4de0-af8f-7d19c44ccbf0 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:58.377269 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fcdfa-1e19-4b08-8952-90fa79afab80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:58.378388 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fcdfa-1e19-4b08-8952-90fa79afab80 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:58.378905 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fcdfa-1e19-4b08-8952-90fa79afab80 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:58.379410 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fcdfa-1e19-4b08-8952-90fa79afab80 None admin] PATH_INFO: `/v3/domains` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:58.380845 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fcdfa-1e19-4b08-8952-90fa79afab80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:58.381377 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fcdfa-1e19-4b08-8952-90fa79afab80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:58.384151 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fcdfa-1e19-4b08-8952-90fa79afab80 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:58.408986 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 433/873] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:05:58.418383 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e011f3-486c-47de-8829-d3db24e3c1d7 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:58.576218 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e011f3-486c-47de-8829-d3db24e3c1d7 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:58.616937 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:58.631652 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be43f0-25f6-40c3-90d0-2cbf0af15f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:58.632806 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be43f0-25f6-40c3-90d0-2cbf0af15f90 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:58.633253 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be43f0-25f6-40c3-90d0-2cbf0af15f90 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:58.633626 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be43f0-25f6-40c3-90d0-2cbf0af15f90 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:58.646561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be43f0-25f6-40c3-90d0-2cbf0af15f90 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:58.648900 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be43f0-25f6-40c3-90d0-2cbf0af15f90 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:58.674135 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-22be43f0-25f6-40c3-90d0-2cbf0af15f90 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 15:05:58.674135 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:05:58.674135 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:05:58.674135 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:05:58.674135 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:05:58.674135 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:05:58.674135 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:05:58.674135 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:05:58.674135 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:05:58.674135 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:05:58.674135 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:05:58.674135 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:05:58.674135 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:05:58.674135 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:05:58.674135 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:05:58.674135 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:05:58.676288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:05:58.676288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:05:58.676288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:05:58.676288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:05:58.676288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:05:58.676288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:05:58.676288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:05:58.676288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:05:58.676288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:05:58.676288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:05:58.676288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:05:58.676288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:05:58.676288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:05:58.676288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:05:58.676288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:05:58.676288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:05:58.676288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:05:58.676288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:05:58.678104 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:05:58.678104 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:05:58.678104 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:05:58.678104 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:05:58.678104 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:05:58.678104 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:05:58.678104 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:05:58.678104 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:05:58.678104 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 15:05:58.678104 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:05:58.678104 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 441/874] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:05:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:05:58.684665 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fcdfa-1e19-4b08-8952-90fa79afab80 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:58.755739 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:58.831382 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fcdfa-1e19-4b08-8952-90fa79afab80 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:58.881405 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721185f3-fe69-48a5-b32c-bd332aced373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:58.882552 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721185f3-fe69-48a5-b32c-bd332aced373 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:58.882850 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721185f3-fe69-48a5-b32c-bd332aced373 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:58.883206 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721185f3-fe69-48a5-b32c-bd332aced373 None admin] PATH_INFO: `/v3/users` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:58.884541 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721185f3-fe69-48a5-b32c-bd332aced373 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:58.885152 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721185f3-fe69-48a5-b32c-bd332aced373 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:58.887308 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721185f3-fe69-48a5-b32c-bd332aced373 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:58.917331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 434/875] 10.222.0.39 () {56 vars in 1143 bytes} [Wed May 25 15:05:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:05:58.919092 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be43f0-25f6-40c3-90d0-2cbf0af15f90 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:59.035478 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be43f0-25f6-40c3-90d0-2cbf0af15f90 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:59.093830 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4e0db-3478-4a9d-aef7-ca4830731354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:59.095563 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4e0db-3478-4a9d-aef7-ca4830731354 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:59.096185 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4e0db-3478-4a9d-aef7-ca4830731354 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:59.097064 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4e0db-3478-4a9d-aef7-ca4830731354 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:59.194985 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:59.212853 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4e0db-3478-4a9d-aef7-ca4830731354 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:59.215695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4e0db-3478-4a9d-aef7-ca4830731354 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:59.369269 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 442/876] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:05:58 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:05:59.375699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721185f3-fe69-48a5-b32c-bd332aced373 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:59.528017 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721185f3-fe69-48a5-b32c-bd332aced373 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:59.542169 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:59.577980 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0feee-2a36-491f-860c-210e2469fda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:59.579402 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0feee-2a36-491f-860c-210e2469fda0 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:59.579902 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0feee-2a36-491f-860c-210e2469fda0 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:59.580402 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0feee-2a36-491f-860c-210e2469fda0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:59.600959 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0feee-2a36-491f-860c-210e2469fda0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:59.603752 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0feee-2a36-491f-860c-210e2469fda0 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:59.637806 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-c5e0feee-2a36-491f-860c-210e2469fda0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:05:59.637806 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:05:59.637806 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:05:59.637806 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:05:59.637806 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:05:59.637806 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:05:59.637806 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:05:59.637806 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:05:59.637806 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:05:59.637806 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:05:59.637806 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:05:59.637806 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:05:59.637806 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:05:59.637806 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:05:59.637806 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:05:59.639340 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:05:59.639340 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:05:59.639340 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:05:59.639340 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:05:59.639340 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:05:59.639340 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:05:59.639340 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:05:59.639340 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:05:59.639340 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:05:59.639340 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:05:59.639340 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:05:59.639340 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:05:59.639340 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:05:59.639340 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:05:59.639340 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:05:59.639340 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:05:59.639340 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:05:59.640515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:05:59.640515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:05:59.640515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:05:59.640515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:05:59.640515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 435/877] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:05:59.646547 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4e0db-3478-4a9d-aef7-ca4830731354 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:05:59.775941 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:05:59.796540 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4e0db-3478-4a9d-aef7-ca4830731354 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:05:59.847742 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f270d8e-dc39-43a6-928f-3777bbffa982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:05:59.848543 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f270d8e-dc39-43a6-928f-3777bbffa982 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:05:59.848940 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f270d8e-dc39-43a6-928f-3777bbffa982 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:05:59.849343 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f270d8e-dc39-43a6-928f-3777bbffa982 None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:05:59.850339 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f270d8e-dc39-43a6-928f-3777bbffa982 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:05:59.850712 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f270d8e-dc39-43a6-928f-3777bbffa982 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:05:59.852655 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f270d8e-dc39-43a6-928f-3777bbffa982 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:05:59.869513 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 443/878] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:05:59.876251 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0feee-2a36-491f-860c-210e2469fda0 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:00.010918 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0feee-2a36-491f-860c-210e2469fda0 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:00.053531 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddb5ec-ff8e-40e5-bda7-0d7af780dd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:00.054746 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddb5ec-ff8e-40e5-bda7-0d7af780dd67 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:00.055225 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddb5ec-ff8e-40e5-bda7-0d7af780dd67 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:00.055789 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddb5ec-ff8e-40e5-bda7-0d7af780dd67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:00.067941 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ddb5ec-ff8e-40e5-bda7-0d7af780dd67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:00.070046 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ddb5ec-ff8e-40e5-bda7-0d7af780dd67 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:00.093831 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-e5ddb5ec-ff8e-40e5-bda7-0d7af780dd67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:06:00.093831 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:06:00.093831 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:06:00.093831 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:06:00.093831 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:06:00.093831 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:06:00.093831 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:06:00.093831 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:06:00.093831 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:06:00.093831 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:06:00.093831 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:06:00.093831 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:06:00.093831 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:06:00.093831 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:06:00.093831 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:06:00.095682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:06:00.095682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:06:00.095682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:06:00.095682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:06:00.095682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:06:00.095682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:06:00.095682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:06:00.095682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:06:00.095682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:06:00.095682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:06:00.095682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:06:00.095682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:06:00.095682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:06:00.095682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:06:00.095682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:06:00.095682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:06:00.095682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:06:00.097365 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:06:00.097365 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:06:00.097365 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:06:00.097365 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:06:00.097365 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:06:00.097365 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:06:00.097365 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:06:00.097365 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:06:00.103957 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 436/879] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:05:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:06:00.105341 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f270d8e-dc39-43a6-928f-3777bbffa982 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:00.251391 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f270d8e-dc39-43a6-928f-3777bbffa982 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:00.307730 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056b083-7892-4c5f-8b50-a4207236ad77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:00.309090 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056b083-7892-4c5f-8b50-a4207236ad77 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:00.309724 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056b083-7892-4c5f-8b50-a4207236ad77 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:00.310289 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056b083-7892-4c5f-8b50-a4207236ad77 None admin] PATH_INFO: `/v3/projects` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:00.311379 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a056b083-7892-4c5f-8b50-a4207236ad77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:06:00.311872 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a056b083-7892-4c5f-8b50-a4207236ad77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:00.314564 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a056b083-7892-4c5f-8b50-a4207236ad77 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:00.334086 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 444/880] 10.222.0.39 () {56 vars in 1148 bytes} [Wed May 25 15:06:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:06:00.341335 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddb5ec-ff8e-40e5-bda7-0d7af780dd67 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:00.370536 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:00.494213 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddb5ec-ff8e-40e5-bda7-0d7af780dd67 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:00.548871 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c50368-9f02-4112-bc04-bce5a3980b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:00.549677 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c50368-9f02-4112-bc04-bce5a3980b6a None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:00.550023 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c50368-9f02-4112-bc04-bce5a3980b6a None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:00.550405 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c50368-9f02-4112-bc04-bce5a3980b6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:00.551438 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c50368-9f02-4112-bc04-bce5a3980b6a None admin] RBAC: Adding query filter params (role.id=ff521c95c8aa454ea3daa6bc36d055b1, scope.project.id=ff4afc67ebcf4840946ce41755f94bf0, user.id=b28b47418d054fe091d379d83a30db11) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:06:00.551811 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c50368-9f02-4112-bc04-bce5a3980b6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:00.553378 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c50368-9f02-4112-bc04-bce5a3980b6a None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:00.560870 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 437/881] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:06:00 2022] GET /identity/v3/role_assignments?user.id=b28b47418d054fe091d379d83a30db11&scope.project.id=ff4afc67ebcf4840946ce41755f94bf0&role.id=ff521c95c8aa454ea3daa6bc36d055b1 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:06:03.084704 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a991d6b-3537-4ffa-8f80-d4ed9834228b None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:03.085391 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a991d6b-3537-4ffa-8f80-d4ed9834228b None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:03.085536 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a991d6b-3537-4ffa-8f80-d4ed9834228b None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:03.087306 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 445/882] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:06:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:03.094178 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff329c-e5c0-4bbc-8005-c53cb7c2c0ac None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:03.094803 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff329c-e5c0-4bbc-8005-c53cb7c2c0ac None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:03.094803 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff329c-e5c0-4bbc-8005-c53cb7c2c0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:03.117158 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-4fff329c-e5c0-4bbc-8005-c53cb7c2c0ac None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:03.118497 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-4fff329c-e5c0-4bbc-8005-c53cb7c2c0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:03.206103 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 438/883] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:06:03 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:06:03.231119 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a991d6b-3537-4ffa-8f80-d4ed9834228b None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:03.242743 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:03.343711 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a991d6b-3537-4ffa-8f80-d4ed9834228b None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:03.382857 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40212a70-e990-4104-928e-b3725107c65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:03.383721 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40212a70-e990-4104-928e-b3725107c65d None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:03.384055 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40212a70-e990-4104-928e-b3725107c65d None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:03.384381 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40212a70-e990-4104-928e-b3725107c65d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:03.395608 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40212a70-e990-4104-928e-b3725107c65d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:06:03.403844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-40212a70-e990-4104-928e-b3725107c65d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:06:03.403844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:06:03.403844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:06:03.403844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:06:03.403844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:06:03.403844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:06:03.403844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:06:03.403844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:06:03.403844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:06:03.403844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:06:03.403844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:06:03.403844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:06:03.403844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:06:03.403844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:06:03.403844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:06:03.403844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:06:03.405614 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:06:03.405614 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:06:03.405614 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:06:03.405614 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:06:03.405614 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:06:03.405614 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:06:03.405614 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:06:03.405614 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:06:03.405614 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:06:03.405614 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:06:03.405614 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:06:03.405614 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:06:03.405614 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:06:03.405614 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:06:03.405614 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:06:03.405614 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:06:03.407252 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:06:03.407252 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:06:03.407252 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:06:03.407252 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:06:03.407252 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:06:03.407252 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:06:03.407252 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:06:03.407252 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:06:03.407252 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:06:03.407252 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:06:03.407252 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:06:03.407252 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:06:03.407252 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 446/884] 10.222.0.39 () {56 vars in 1096 bytes} [Wed May 25 15:06:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:06:03.411627 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff329c-e5c0-4bbc-8005-c53cb7c2c0ac None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:03.428289 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:03.521935 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff329c-e5c0-4bbc-8005-c53cb7c2c0ac None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:03.563684 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58ae13-bf4d-463a-b983-3bfa9fc1e32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:03.564370 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58ae13-bf4d-463a-b983-3bfa9fc1e32a None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:03.564660 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58ae13-bf4d-463a-b983-3bfa9fc1e32a None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:03.564942 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58ae13-bf4d-463a-b983-3bfa9fc1e32a None admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:03.565712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58ae13-bf4d-463a-b983-3bfa9fc1e32a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:06:03.566026 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58ae13-bf4d-463a-b983-3bfa9fc1e32a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:03.567506 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58ae13-bf4d-463a-b983-3bfa9fc1e32a None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:03.577173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 439/885] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:06:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:06:03.584750 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40212a70-e990-4104-928e-b3725107c65d None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:03.673288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:03.715160 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40212a70-e990-4104-928e-b3725107c65d None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:03.751549 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7507451-912f-4a36-a6d4-e8706e617d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:03.752427 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7507451-912f-4a36-a6d4-e8706e617d15 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:03.752755 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7507451-912f-4a36-a6d4-e8706e617d15 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:03.753076 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7507451-912f-4a36-a6d4-e8706e617d15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:03.764785 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7507451-912f-4a36-a6d4-e8706e617d15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:03.766274 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7507451-912f-4a36-a6d4-e8706e617d15 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:03.784733 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-f7507451-912f-4a36-a6d4-e8706e617d15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:06:03.784733 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:06:03.784733 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:06:03.784733 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:06:03.784733 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:06:03.784733 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:06:03.784733 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:06:03.784733 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:06:03.784733 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:06:03.784733 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:06:03.784733 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:06:03.784733 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:06:03.784733 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:06:03.784733 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:06:03.784733 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:06:03.786467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:06:03.786467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:06:03.786467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:06:03.786467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:06:03.786467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:06:03.786467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:06:03.786467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:06:03.786467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:06:03.786467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:06:03.786467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:06:03.786467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:06:03.786467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:06:03.786467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:06:03.786467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:06:03.786467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:06:03.786467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:06:03.786467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:06:03.788150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:06:03.788150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:06:03.788150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:06:03.788150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:06:03.788150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 447/886] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:06:03.793311 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58ae13-bf4d-463a-b983-3bfa9fc1e32a None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:03.878884 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:03.908290 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58ae13-bf4d-463a-b983-3bfa9fc1e32a None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:03.977126 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd409b-9181-4eaa-8ed9-dc20bd54ae99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:03.978194 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd409b-9181-4eaa-8ed9-dc20bd54ae99 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:03.978735 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd409b-9181-4eaa-8ed9-dc20bd54ae99 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:03.979206 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd409b-9181-4eaa-8ed9-dc20bd54ae99 None admin] PATH_INFO: `/v3/domains` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:03.980549 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd409b-9181-4eaa-8ed9-dc20bd54ae99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:06:03.981087 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd409b-9181-4eaa-8ed9-dc20bd54ae99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:03.984828 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd409b-9181-4eaa-8ed9-dc20bd54ae99 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:04.008748 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 440/887] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:06:04.015181 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7507451-912f-4a36-a6d4-e8706e617d15 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:04.138007 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7507451-912f-4a36-a6d4-e8706e617d15 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:04.163072 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:04.180033 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe94943-5187-4afd-bd8f-5d91e06b0b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:04.180865 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe94943-5187-4afd-bd8f-5d91e06b0b54 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:04.181465 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe94943-5187-4afd-bd8f-5d91e06b0b54 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:04.181736 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe94943-5187-4afd-bd8f-5d91e06b0b54 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:04.190823 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe94943-5187-4afd-bd8f-5d91e06b0b54 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:04.192271 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe94943-5187-4afd-bd8f-5d91e06b0b54 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:04.207393 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-cbe94943-5187-4afd-bd8f-5d91e06b0b54 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 15:06:04.207393 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:06:04.207393 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:06:04.207393 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:06:04.207393 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:06:04.207393 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:06:04.207393 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:06:04.207393 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:06:04.207393 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:06:04.207393 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:06:04.207393 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:06:04.207393 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:06:04.207393 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:06:04.207393 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:06:04.207393 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:06:04.207393 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:06:04.208551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:06:04.208551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:06:04.208551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:06:04.208551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:06:04.208551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:06:04.208551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:06:04.208551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:06:04.208551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:06:04.208551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:06:04.208551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:06:04.208551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:06:04.208551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:06:04.208551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:06:04.208551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:06:04.208551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:06:04.208551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:06:04.208551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:06:04.208551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:06:04.209969 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:06:04.209969 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:06:04.209969 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:06:04.209969 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:06:04.209969 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:06:04.209969 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:06:04.209969 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:06:04.209969 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:06:04.209969 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 15:06:04.209969 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:06:04.209969 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 448/888] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:06:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:06:04.214661 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd409b-9181-4eaa-8ed9-dc20bd54ae99 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:04.321001 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd409b-9181-4eaa-8ed9-dc20bd54ae99 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:04.357858 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6016ecf-09f2-4d6e-ae0b-7978d0176f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:04.358582 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6016ecf-09f2-4d6e-ae0b-7978d0176f85 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:04.358867 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6016ecf-09f2-4d6e-ae0b-7978d0176f85 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:04.359141 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6016ecf-09f2-4d6e-ae0b-7978d0176f85 None admin] PATH_INFO: `/v3/users` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:04.359987 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6016ecf-09f2-4d6e-ae0b-7978d0176f85 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:06:04.360299 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6016ecf-09f2-4d6e-ae0b-7978d0176f85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:04.361747 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6016ecf-09f2-4d6e-ae0b-7978d0176f85 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:04.364701 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:04.380685 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 441/889] 10.222.0.39 () {56 vars in 1143 bytes} [Wed May 25 15:06:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:06:04.386687 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe94943-5187-4afd-bd8f-5d91e06b0b54 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:04.502138 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe94943-5187-4afd-bd8f-5d91e06b0b54 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:04.539420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9cc3c-2d24-4e55-af10-3e282244e25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:04.540231 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9cc3c-2d24-4e55-af10-3e282244e25c None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:04.540509 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9cc3c-2d24-4e55-af10-3e282244e25c None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:04.540776 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9cc3c-2d24-4e55-af10-3e282244e25c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:04.554107 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9cc3c-2d24-4e55-af10-3e282244e25c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:04.556074 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9cc3c-2d24-4e55-af10-3e282244e25c None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:04.576837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-9da9cc3c-2d24-4e55-af10-3e282244e25c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:06:04.576837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:06:04.576837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:06:04.576837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:06:04.576837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:06:04.576837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:06:04.576837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:06:04.576837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:06:04.576837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:06:04.576837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:06:04.576837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:06:04.576837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:06:04.576837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:06:04.576837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:06:04.576837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:06:04.578513 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:06:04.578513 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:06:04.578513 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:06:04.578513 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:06:04.578513 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:06:04.578513 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:06:04.578513 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:06:04.578513 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:06:04.578513 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:06:04.578513 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:06:04.578513 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:06:04.578513 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:06:04.578513 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:06:04.578513 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:06:04.578513 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:06:04.578513 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:06:04.578513 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:06:04.580467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:06:04.580467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:06:04.580467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:06:04.580467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:06:04.580467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 449/890] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:06:04.585099 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6016ecf-09f2-4d6e-ae0b-7978d0176f85 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:04.713558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6016ecf-09f2-4d6e-ae0b-7978d0176f85 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:04.755921 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd3f3e-5c70-4b7c-8de5-5dedc6c09c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:04.756602 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd3f3e-5c70-4b7c-8de5-5dedc6c09c23 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:04.756882 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd3f3e-5c70-4b7c-8de5-5dedc6c09c23 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:04.757153 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd3f3e-5c70-4b7c-8de5-5dedc6c09c23 None admin] PATH_INFO: `/v3/domains` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:04.757876 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd3f3e-5c70-4b7c-8de5-5dedc6c09c23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:06:04.758179 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd3f3e-5c70-4b7c-8de5-5dedc6c09c23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:04.759586 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd3f3e-5c70-4b7c-8de5-5dedc6c09c23 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:04.772546 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 442/891] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:06:04.778658 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9cc3c-2d24-4e55-af10-3e282244e25c None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:04.813091 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:04.894959 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9cc3c-2d24-4e55-af10-3e282244e25c None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:04.938493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd31da9-7a90-4b44-b42c-9d62b46efdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:04.939317 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd31da9-7a90-4b44-b42c-9d62b46efdb2 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:04.939603 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd31da9-7a90-4b44-b42c-9d62b46efdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:04.939878 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd31da9-7a90-4b44-b42c-9d62b46efdb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:04.947837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd31da9-7a90-4b44-b42c-9d62b46efdb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:04.949341 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd31da9-7a90-4b44-b42c-9d62b46efdb2 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:04.966033 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-6fd31da9-7a90-4b44-b42c-9d62b46efdb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:06:04.966033 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:06:04.966033 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:06:04.966033 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:06:04.966033 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:06:04.966033 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:06:04.966033 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:06:04.966033 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:06:04.966033 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:06:04.966033 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:06:04.966033 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:06:04.966033 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:06:04.966033 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:06:04.966033 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:06:04.966033 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:06:04.968077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:06:04.968077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:06:04.968077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:06:04.968077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:06:04.968077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:06:04.968077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:06:04.968077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:06:04.968077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:06:04.968077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:06:04.968077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:06:04.968077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:06:04.968077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:06:04.968077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:06:04.968077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:06:04.968077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:06:04.968077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:06:04.968077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:06:04.969820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:06:04.969820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:06:04.969820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:06:04.969820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:06:04.969820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:06:04.969820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:06:04.969820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:06:04.969820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:06:04.971936 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 450/892] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:06:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:06:04.973937 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd3f3e-5c70-4b7c-8de5-5dedc6c09c23 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:05.045969 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:05.115765 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd3f3e-5c70-4b7c-8de5-5dedc6c09c23 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:05.168561 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e6545-65cc-4b13-bd6a-9729a577b4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:05.169263 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e6545-65cc-4b13-bd6a-9729a577b4e4 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:05.169775 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e6545-65cc-4b13-bd6a-9729a577b4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:05.170205 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e6545-65cc-4b13-bd6a-9729a577b4e4 None admin] PATH_INFO: `/v3/projects` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:05.171066 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e6545-65cc-4b13-bd6a-9729a577b4e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:06:05.171382 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e6545-65cc-4b13-bd6a-9729a577b4e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:05.172850 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e6545-65cc-4b13-bd6a-9729a577b4e4 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:05.187302 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 443/893] 10.222.0.39 () {56 vars in 1148 bytes} [Wed May 25 15:06:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:06:05.193591 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd31da9-7a90-4b44-b42c-9d62b46efdb2 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:05.308837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:05.319630 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd31da9-7a90-4b44-b42c-9d62b46efdb2 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:05.371655 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f2951-cf11-432a-8ac4-657246cd7d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:05.374484 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f2951-cf11-432a-8ac4-657246cd7d6c None admin] REQUEST_METHOD: `PUT` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:05.374959 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f2951-cf11-432a-8ac4-657246cd7d6c None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:05.375440 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f2951-cf11-432a-8ac4-657246cd7d6c None admin] PATH_INFO: `/v3/projects/ff4afc67ebcf4840946ce41755f94bf0/users/b28b47418d054fe091d379d83a30db11/roles/ff521c95c8aa454ea3daa6bc36d055b1` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:05.378992 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f2951-cf11-432a-8ac4-657246cd7d6c None admin] RBAC: Authorizing `identity:create_grant(project_id=ff4afc67ebcf4840946ce41755f94bf0, user_id=b28b47418d054fe091d379d83a30db11, role_id=ff521c95c8aa454ea3daa6bc36d055b1)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:05.381708 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f2951-cf11-432a-8ac4-657246cd7d6c None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:05.398563 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 451/894] 10.222.0.39 () {58 vars in 1439 bytes} [Wed May 25 15:06:05 2022] PUT /identity/v3/projects/ff4afc67ebcf4840946ce41755f94bf0/users/b28b47418d054fe091d379d83a30db11/roles/ff521c95c8aa454ea3daa6bc36d055b1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:06:07.769282 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0c741-abbc-43d3-bd07-f3fda86ba1a2 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:07.769839 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0c741-abbc-43d3-bd07-f3fda86ba1a2 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:07.769839 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0c741-abbc-43d3-bd07-f3fda86ba1a2 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:07.771144 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 444/895] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:06:07.778198 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6517e4c-7c8d-496f-b079-85d8243b2973 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:07.778809 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6517e4c-7c8d-496f-b079-85d8243b2973 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:07.779320 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6517e4c-7c8d-496f-b079-85d8243b2973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:07.807393 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-f6517e4c-7c8d-496f-b079-85d8243b2973 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:07.809524 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-f6517e4c-7c8d-496f-b079-85d8243b2973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:07.898336 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 452/896] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:06:07 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:06:07.925666 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0c741-abbc-43d3-bd07-f3fda86ba1a2 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:08.107624 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0c741-abbc-43d3-bd07-f3fda86ba1a2 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:08.142987 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:08.180068 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f07f7-ac2d-45eb-a246-9e8b385ebab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:08.181796 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f07f7-ac2d-45eb-a246-9e8b385ebab2 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:08.182310 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f07f7-ac2d-45eb-a246-9e8b385ebab2 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:08.182840 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f07f7-ac2d-45eb-a246-9e8b385ebab2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:08.202930 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f07f7-ac2d-45eb-a246-9e8b385ebab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:06:08.218356 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-2e3f07f7-ac2d-45eb-a246-9e8b385ebab2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:06:08.218356 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:06:08.218356 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:06:08.218356 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:06:08.218356 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:06:08.218356 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:06:08.218356 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:06:08.218356 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:06:08.218356 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:06:08.218356 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:06:08.218356 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:06:08.218356 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:06:08.218356 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:06:08.218356 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:06:08.218356 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:06:08.218356 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:06:08.219637 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:06:08.219637 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:06:08.219637 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:06:08.219637 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:06:08.219637 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:06:08.219637 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:06:08.219637 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:06:08.219637 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:06:08.219637 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:06:08.219637 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:06:08.219637 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:06:08.219637 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:06:08.219637 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:06:08.219637 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:06:08.219637 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:06:08.219637 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:06:08.220670 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:06:08.220670 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:06:08.220670 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:06:08.220670 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:06:08.220670 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:06:08.220670 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:06:08.220670 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:06:08.220670 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:06:08.220670 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:06:08.220670 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:06:08.220670 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:06:08.220670 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:06:08.221429 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 445/897] 10.222.0.39 () {56 vars in 1096 bytes} [Wed May 25 15:06:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:06:08.227349 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6517e4c-7c8d-496f-b079-85d8243b2973 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:08.323911 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:08.346645 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6517e4c-7c8d-496f-b079-85d8243b2973 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:08.385805 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95285c18-7791-4bb5-9568-cdc79dcff65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:08.386378 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95285c18-7791-4bb5-9568-cdc79dcff65d None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:08.386658 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95285c18-7791-4bb5-9568-cdc79dcff65d None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:08.386927 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95285c18-7791-4bb5-9568-cdc79dcff65d None admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:08.387782 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95285c18-7791-4bb5-9568-cdc79dcff65d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:06:08.388018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95285c18-7791-4bb5-9568-cdc79dcff65d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:08.389449 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95285c18-7791-4bb5-9568-cdc79dcff65d None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:08.398807 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 453/898] 10.222.0.39 () {56 vars in 1099 bytes} [Wed May 25 15:06:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:06:08.405012 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f07f7-ac2d-45eb-a246-9e8b385ebab2 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:08.526112 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f07f7-ac2d-45eb-a246-9e8b385ebab2 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:08.564994 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65768af-e598-44f9-96d2-a2bb54c7a73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:08.565798 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65768af-e598-44f9-96d2-a2bb54c7a73b None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:08.566077 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65768af-e598-44f9-96d2-a2bb54c7a73b None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:08.566383 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65768af-e598-44f9-96d2-a2bb54c7a73b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:08.580085 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65768af-e598-44f9-96d2-a2bb54c7a73b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:08.581575 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65768af-e598-44f9-96d2-a2bb54c7a73b None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:08.600832 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-b65768af-e598-44f9-96d2-a2bb54c7a73b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:06:08.600832 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:06:08.600832 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:06:08.600832 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:06:08.600832 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:06:08.600832 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:06:08.600832 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:06:08.600832 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:06:08.600832 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:06:08.600832 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:06:08.600832 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:06:08.600832 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:06:08.600832 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:06:08.600832 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:06:08.600832 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:06:08.602513 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:06:08.602513 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:06:08.602513 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:06:08.602513 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:06:08.602513 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:06:08.602513 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:06:08.602513 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:06:08.602513 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:06:08.602513 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:06:08.602513 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:06:08.602513 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:06:08.602513 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:06:08.602513 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:06:08.602513 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:06:08.602513 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:06:08.602513 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:06:08.602513 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:06:08.604202 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:06:08.604202 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:06:08.604202 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:06:08.604202 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:06:08.604202 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 446/899] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:06:08.609687 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95285c18-7791-4bb5-9568-cdc79dcff65d None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:08.725082 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95285c18-7791-4bb5-9568-cdc79dcff65d None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:08.767506 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192770fd-cf12-47e6-b2a8-f5d83e7a39f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:08.768184 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192770fd-cf12-47e6-b2a8-f5d83e7a39f6 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:08.768462 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192770fd-cf12-47e6-b2a8-f5d83e7a39f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:08.768735 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192770fd-cf12-47e6-b2a8-f5d83e7a39f6 None admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:08.769465 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192770fd-cf12-47e6-b2a8-f5d83e7a39f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:06:08.769776 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192770fd-cf12-47e6-b2a8-f5d83e7a39f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:08.771187 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192770fd-cf12-47e6-b2a8-f5d83e7a39f6 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:08.784759 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 454/900] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:06:08.791037 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65768af-e598-44f9-96d2-a2bb54c7a73b None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:08.826026 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:08.911004 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65768af-e598-44f9-96d2-a2bb54c7a73b None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:08.950450 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46809fc-01bc-41fd-bfe5-0f283dd4afac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:08.951851 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46809fc-01bc-41fd-bfe5-0f283dd4afac None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:08.952140 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46809fc-01bc-41fd-bfe5-0f283dd4afac None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:08.952415 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46809fc-01bc-41fd-bfe5-0f283dd4afac None admin] PATH_INFO: `/v3/users/placement` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:08.961757 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46809fc-01bc-41fd-bfe5-0f283dd4afac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:08.963263 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46809fc-01bc-41fd-bfe5-0f283dd4afac None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:08.980297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-d46809fc-01bc-41fd-bfe5-0f283dd4afac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 15:06:08.980297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:06:08.980297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:06:08.980297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:06:08.980297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:06:08.980297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:06:08.980297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:06:08.980297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:06:08.980297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:06:08.980297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:06:08.980297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:06:08.980297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:06:08.980297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:06:08.980297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:06:08.980297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:06:08.980297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:06:08.982076 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:06:08.982076 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:06:08.982076 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:06:08.982076 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:06:08.982076 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:06:08.982076 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:06:08.982076 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:06:08.982076 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:06:08.982076 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:06:08.982076 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:06:08.982076 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:06:08.982076 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:06:08.982076 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:06:08.982076 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:06:08.982076 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:06:08.982076 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:06:08.982076 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:06:08.982076 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:06:08.983840 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:06:08.983840 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:06:08.983840 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:06:08.983840 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:06:08.983840 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:06:08.983840 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:06:08.983840 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:06:08.983840 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:06:08.983840 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 15:06:08.983840 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:06:08.983840 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 447/901] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:06:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:06:08.990821 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192770fd-cf12-47e6-b2a8-f5d83e7a39f6 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:08.994967 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:09.106268 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192770fd-cf12-47e6-b2a8-f5d83e7a39f6 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:09.146488 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe36f8-1d7c-4989-b436-247bb655f4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:09.147149 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe36f8-1d7c-4989-b436-247bb655f4bd None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:09.147426 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe36f8-1d7c-4989-b436-247bb655f4bd None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:09.147698 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe36f8-1d7c-4989-b436-247bb655f4bd None admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:09.148536 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe36f8-1d7c-4989-b436-247bb655f4bd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:06:09.148844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe36f8-1d7c-4989-b436-247bb655f4bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:09.150299 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe36f8-1d7c-4989-b436-247bb655f4bd None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:09.170706 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 455/902] 10.222.0.39 () {56 vars in 1143 bytes} [Wed May 25 15:06:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:06:09.179672 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46809fc-01bc-41fd-bfe5-0f283dd4afac None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:09.285244 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:09.302892 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46809fc-01bc-41fd-bfe5-0f283dd4afac None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:09.341084 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d853359-e40d-4720-be55-76f4c8c704a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:09.341777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d853359-e40d-4720-be55-76f4c8c704a1 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:09.342056 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d853359-e40d-4720-be55-76f4c8c704a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:09.342369 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d853359-e40d-4720-be55-76f4c8c704a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:09.417265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d853359-e40d-4720-be55-76f4c8c704a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:09.418914 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d853359-e40d-4720-be55-76f4c8c704a1 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:09.532872 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:09.551565 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 448/903] 10.222.0.39 () {58 vars in 1282 bytes} [Wed May 25 15:06:09 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:06:09.558010 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe36f8-1d7c-4989-b436-247bb655f4bd None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:09.631242 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:09.678812 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe36f8-1d7c-4989-b436-247bb655f4bd None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:09.719127 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00496f77-12b6-41f2-a1fd-1d7c4101ce13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:09.719944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00496f77-12b6-41f2-a1fd-1d7c4101ce13 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:09.720221 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00496f77-12b6-41f2-a1fd-1d7c4101ce13 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:09.720491 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00496f77-12b6-41f2-a1fd-1d7c4101ce13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:09.732049 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00496f77-12b6-41f2-a1fd-1d7c4101ce13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:09.733563 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00496f77-12b6-41f2-a1fd-1d7c4101ce13 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:09.753143 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-00496f77-12b6-41f2-a1fd-1d7c4101ce13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:06:09.753143 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:06:09.753143 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:06:09.753143 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:06:09.753143 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:06:09.753143 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:06:09.753143 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:06:09.753143 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:06:09.753143 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:06:09.753143 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:06:09.753143 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:06:09.753143 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:06:09.753143 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:06:09.753143 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:06:09.753143 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:06:09.754915 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:06:09.754915 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:06:09.754915 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:06:09.754915 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:06:09.754915 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:06:09.754915 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:06:09.754915 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:06:09.754915 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:06:09.754915 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:06:09.754915 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:06:09.754915 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:06:09.754915 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:06:09.754915 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:06:09.754915 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:06:09.754915 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:06:09.754915 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:06:09.754915 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:06:09.756838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:06:09.756838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:06:09.756838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:06:09.756838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:06:09.756838 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 456/904] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:06:09.762462 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d853359-e40d-4720-be55-76f4c8c704a1 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:09.941147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d853359-e40d-4720-be55-76f4c8c704a1 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:09.984412 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d82388-2a8f-4981-94a6-32deb56059bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:09.985115 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d82388-2a8f-4981-94a6-32deb56059bb None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:09.985399 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d82388-2a8f-4981-94a6-32deb56059bb None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:09.985674 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d82388-2a8f-4981-94a6-32deb56059bb None admin] PATH_INFO: `/v3/domains` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:09.986469 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d82388-2a8f-4981-94a6-32deb56059bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:06:09.986769 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d82388-2a8f-4981-94a6-32deb56059bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:09.988209 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d82388-2a8f-4981-94a6-32deb56059bb None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:10.002802 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 449/905] 10.222.0.39 () {56 vars in 1109 bytes} [Wed May 25 15:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:06:10.011385 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00496f77-12b6-41f2-a1fd-1d7c4101ce13 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:10.140410 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00496f77-12b6-41f2-a1fd-1d7c4101ce13 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:10.159952 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:10.186897 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45aac3-5bf8-4e0b-9c30-22dbcf6a1965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:10.187746 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45aac3-5bf8-4e0b-9c30-22dbcf6a1965 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:10.188028 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45aac3-5bf8-4e0b-9c30-22dbcf6a1965 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:10.188301 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45aac3-5bf8-4e0b-9c30-22dbcf6a1965 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:10.196757 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45aac3-5bf8-4e0b-9c30-22dbcf6a1965 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:10.198187 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45aac3-5bf8-4e0b-9c30-22dbcf6a1965 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:10.214671 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application [None req-fa45aac3-5bf8-4e0b-9c30-22dbcf6a1965 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:06:10.214671 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:06:10.214671 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:06:10.214671 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:06:10.214671 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:06:10.214671 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:06:10.214671 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:06:10.214671 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:06:10.214671 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:06:10.214671 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:06:10.214671 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:06:10.214671 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:06:10.214671 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:06:10.214671 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:06:10.214671 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:06:10.216945 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:06:10.216945 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:06:10.216945 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:06:10.216945 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:06:10.216945 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:06:10.216945 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:06:10.216945 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:06:10.216945 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:06:10.216945 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application with Lock( May 25 15:06:10.216945 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:06:10.216945 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._enter() May 25 15:06:10.216945 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:06:10.216945 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:06:10.216945 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:06:10.216945 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.creator() May 25 15:06:10.216945 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:06:10.216945 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application created_value = creator( May 25 15:06:10.219043 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:06:10.219043 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:06:10.219043 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:06:10.219043 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:06:10.219043 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:06:10.219043 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:06:10.219043 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:06:10.219043 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: ERROR keystone.server.flask.application May 25 15:06:10.219043 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 457/906] 10.222.0.39 () {56 vars in 1111 bytes} [Wed May 25 15:06:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:06:10.225054 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d82388-2a8f-4981-94a6-32deb56059bb None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:10.286086 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:10.354072 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d82388-2a8f-4981-94a6-32deb56059bb None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:10.395957 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d7e48-5014-4250-8a32-99ce116e6bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:10.396656 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d7e48-5014-4250-8a32-99ce116e6bb5 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:10.396940 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d7e48-5014-4250-8a32-99ce116e6bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:10.397215 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d7e48-5014-4250-8a32-99ce116e6bb5 None admin] PATH_INFO: `/v3/projects` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:10.398031 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d7e48-5014-4250-8a32-99ce116e6bb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:06:10.398347 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d7e48-5014-4250-8a32-99ce116e6bb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:10.399865 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d7e48-5014-4250-8a32-99ce116e6bb5 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:10.414684 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 450/907] 10.222.0.39 () {56 vars in 1148 bytes} [Wed May 25 15:06:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:06:10.422698 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45aac3-5bf8-4e0b-9c30-22dbcf6a1965 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:10.589821 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45aac3-5bf8-4e0b-9c30-22dbcf6a1965 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:10.629606 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f635f41-f97d-4a95-a882-3913756eb210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:10.630306 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f635f41-f97d-4a95-a882-3913756eb210 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:10.630586 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f635f41-f97d-4a95-a882-3913756eb210 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:10.630856 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f635f41-f97d-4a95-a882-3913756eb210 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:10.631697 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f635f41-f97d-4a95-a882-3913756eb210 None admin] RBAC: Adding query filter params (role.id=ff521c95c8aa454ea3daa6bc36d055b1, scope.project.id=ff4afc67ebcf4840946ce41755f94bf0, user.id=b28b47418d054fe091d379d83a30db11) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:06:10.632007 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f635f41-f97d-4a95-a882-3913756eb210 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:10.633541 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f635f41-f97d-4a95-a882-3913756eb210 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:10.640405 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 458/908] 10.222.0.39 () {56 vars in 1374 bytes} [Wed May 25 15:06:10 2022] GET /identity/v3/role_assignments?user.id=b28b47418d054fe091d379d83a30db11&scope.project.id=ff4afc67ebcf4840946ce41755f94bf0&role.id=ff521c95c8aa454ea3daa6bc36d055b1 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:06:13.022050 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0e119-23ff-4eb7-89a1-40b88ba80643 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:13.022757 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0e119-23ff-4eb7-89a1-40b88ba80643 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:13.022757 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0e119-23ff-4eb7-89a1-40b88ba80643 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:13.024003 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 451/909] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:06:13.030219 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047b4da-9e54-4e3d-82a4-19945dde923f None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:13.030803 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047b4da-9e54-4e3d-82a4-19945dde923f None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:13.030903 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047b4da-9e54-4e3d-82a4-19945dde923f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:13.048727 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-f047b4da-9e54-4e3d-82a4-19945dde923f None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:13.049976 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-f047b4da-9e54-4e3d-82a4-19945dde923f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:13.089745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:13.144579 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 459/910] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:06:13 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:06:13.178484 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0e119-23ff-4eb7-89a1-40b88ba80643 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:13.302674 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0e119-23ff-4eb7-89a1-40b88ba80643 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:13.312079 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:13.345239 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0bc1f-d243-485c-a255-f97d833cc786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:13.346081 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0bc1f-d243-485c-a255-f97d833cc786 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:13.346407 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0bc1f-d243-485c-a255-f97d833cc786 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:13.346683 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0bc1f-d243-485c-a255-f97d833cc786 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:13.347356 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0bc1f-d243-485c-a255-f97d833cc786 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:13.348791 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0bc1f-d243-485c-a255-f97d833cc786 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:13.362131 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-04c0bc1f-d243-485c-a255-f97d833cc786 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:06:13.362131 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:06:13.362131 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:06:13.362131 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:06:13.362131 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:06:13.362131 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:06:13.362131 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:06:13.362131 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:06:13.362131 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:06:13.362131 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:06:13.362131 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:06:13.362131 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:06:13.362131 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:06:13.362131 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:06:13.362131 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:06:13.362131 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:06:13.362131 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:06:13.363730 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:06:13.363730 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:06:13.363730 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:06:13.363730 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:06:13.363730 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:06:13.363730 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:06:13.363730 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:06:13.363730 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:06:13.363730 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:06:13.363730 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:06:13.363730 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:06:13.363730 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:06:13.363730 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:06:13.363730 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:06:13.363730 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:06:13.363730 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:06:13.365357 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:06:13.365357 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:06:13.365357 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:06:13.365357 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:06:13.365357 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:06:13.365357 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:06:13.365357 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:06:13.365357 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:06:13.365357 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:06:13.365357 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:06:13.365357 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:06:13.365357 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:06:13.365357 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:06:13.365357 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:06:13.365357 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 452/911] 10.222.0.39 () {56 vars in 1117 bytes} [Wed May 25 15:06:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:06:13.371660 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047b4da-9e54-4e3d-82a4-19945dde923f None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:13.489213 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047b4da-9e54-4e3d-82a4-19945dde923f None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:13.525574 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab32f5b-2894-4dc7-be95-6decfd81c688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:13.526276 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab32f5b-2894-4dc7-be95-6decfd81c688 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:13.526551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab32f5b-2894-4dc7-be95-6decfd81c688 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:13.526828 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab32f5b-2894-4dc7-be95-6decfd81c688 None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:13.527530 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab32f5b-2894-4dc7-be95-6decfd81c688 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:06:13.527834 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab32f5b-2894-4dc7-be95-6decfd81c688 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:13.529557 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab32f5b-2894-4dc7-be95-6decfd81c688 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:13.535319 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 460/912] 10.222.0.39 () {56 vars in 1116 bytes} [Wed May 25 15:06:13 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:06:13.542108 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0bc1f-d243-485c-a255-f97d833cc786 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:13.658710 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0bc1f-d243-485c-a255-f97d833cc786 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:13.696028 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8cf11d-80e2-4dfa-9e62-c13ed8ad3a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:13.696710 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cf11d-80e2-4dfa-9e62-c13ed8ad3a7b None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:13.696990 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cf11d-80e2-4dfa-9e62-c13ed8ad3a7b None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:13.697265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cf11d-80e2-4dfa-9e62-c13ed8ad3a7b None admin] PATH_INFO: `/v3/services` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:13.697992 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8cf11d-80e2-4dfa-9e62-c13ed8ad3a7b None admin] RBAC: Adding query filter params (type=placement) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:06:13.698322 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8cf11d-80e2-4dfa-9e62-c13ed8ad3a7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:13.699729 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8cf11d-80e2-4dfa-9e62-c13ed8ad3a7b None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:13.705511 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 453/913] 10.222.0.39 () {56 vars in 1116 bytes} [Wed May 25 15:06:13 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:06:16.050792 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18948133-611d-4034-8387-778ca8f1ded1 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:16.051538 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18948133-611d-4034-8387-778ca8f1ded1 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:16.051538 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18948133-611d-4034-8387-778ca8f1ded1 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:16.052717 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 461/914] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:16.059033 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c6666-f93c-45e7-a636-2013518dce44 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:16.059842 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c6666-f93c-45e7-a636-2013518dce44 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:16.059842 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c6666-f93c-45e7-a636-2013518dce44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:16.078229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-cd3c6666-f93c-45e7-a636-2013518dce44 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:16.079526 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-cd3c6666-f93c-45e7-a636-2013518dce44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:16.126332 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:16.189258 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 454/915] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:06:16 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:06:16.213710 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18948133-611d-4034-8387-778ca8f1ded1 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:16.247194 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:16.328455 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18948133-611d-4034-8387-778ca8f1ded1 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:16.366166 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495107d-9ab0-4490-ace5-12eb3b5511d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:16.366861 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495107d-9ab0-4490-ace5-12eb3b5511d6 None admin] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:16.367154 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495107d-9ab0-4490-ace5-12eb3b5511d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:16.367422 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495107d-9ab0-4490-ace5-12eb3b5511d6 None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:16.368160 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495107d-9ab0-4490-ace5-12eb3b5511d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:16.369530 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495107d-9ab0-4490-ace5-12eb3b5511d6 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:16.384943 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 462/916] 10.222.0.39 () {60 vars in 1141 bytes} [Wed May 25 15:06:16 2022] POST /identity/v3/services => generated 246 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:06:18.740921 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae0df9-a7f0-425c-bf68-317929eafd98 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:18.741465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae0df9-a7f0-425c-bf68-317929eafd98 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:18.741465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae0df9-a7f0-425c-bf68-317929eafd98 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:18.743029 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 455/917] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:18.749277 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef17d09-4443-435c-b721-9e110bf09478 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:18.749849 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef17d09-4443-435c-b721-9e110bf09478 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:18.749849 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef17d09-4443-435c-b721-9e110bf09478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:18.768315 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-4ef17d09-4443-435c-b721-9e110bf09478 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:18.769622 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-4ef17d09-4443-435c-b721-9e110bf09478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:18.860241 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 463/918] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:06:18 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:06:18.884714 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae0df9-a7f0-425c-bf68-317929eafd98 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:18.996605 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae0df9-a7f0-425c-bf68-317929eafd98 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:19.034231 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19b6c5-19d7-4a2a-9bcc-22c9e1325343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:19.035078 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19b6c5-19d7-4a2a-9bcc-22c9e1325343 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:19.035365 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19b6c5-19d7-4a2a-9bcc-22c9e1325343 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:19.035638 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19b6c5-19d7-4a2a-9bcc-22c9e1325343 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:19.036299 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19b6c5-19d7-4a2a-9bcc-22c9e1325343 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:19.037678 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19b6c5-19d7-4a2a-9bcc-22c9e1325343 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:19.050451 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-1d19b6c5-19d7-4a2a-9bcc-22c9e1325343 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:06:19.050451 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:06:19.050451 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:06:19.050451 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:06:19.050451 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:06:19.050451 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:06:19.050451 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:06:19.050451 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:06:19.050451 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:06:19.050451 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:06:19.050451 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:06:19.050451 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:06:19.050451 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:06:19.050451 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:06:19.050451 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:06:19.050451 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:06:19.050451 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:06:19.051686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:06:19.051686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:06:19.051686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:06:19.051686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:06:19.051686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:06:19.051686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:06:19.051686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:06:19.051686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:06:19.051686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:06:19.051686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:06:19.051686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:06:19.051686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:06:19.051686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:06:19.051686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:06:19.051686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:06:19.051686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:06:19.052712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:06:19.052712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:06:19.052712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:06:19.052712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:06:19.052712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:06:19.052712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:06:19.052712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:06:19.052712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:06:19.052712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:06:19.052712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:06:19.052712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:06:19.052712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:06:19.052712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:06:19.052712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:06:19.052712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 456/919] 10.222.0.39 () {56 vars in 1117 bytes} [Wed May 25 15:06:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:06:19.059712 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef17d09-4443-435c-b721-9e110bf09478 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:19.081775 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:19.185646 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef17d09-4443-435c-b721-9e110bf09478 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:19.229068 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078dc81f-cd02-4e5e-b0c4-78453583c442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:19.229757 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078dc81f-cd02-4e5e-b0c4-78453583c442 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:19.230044 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078dc81f-cd02-4e5e-b0c4-78453583c442 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:19.230358 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078dc81f-cd02-4e5e-b0c4-78453583c442 None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:19.231099 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078dc81f-cd02-4e5e-b0c4-78453583c442 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:06:19.231458 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078dc81f-cd02-4e5e-b0c4-78453583c442 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:19.232874 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078dc81f-cd02-4e5e-b0c4-78453583c442 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:19.239038 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 464/920] 10.222.0.39 () {56 vars in 1116 bytes} [Wed May 25 15:06:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:06:19.245929 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19b6c5-19d7-4a2a-9bcc-22c9e1325343 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:19.281219 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:19.367069 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19b6c5-19d7-4a2a-9bcc-22c9e1325343 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:19.407532 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9690210-8756-411d-97f4-82328f3407bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:19.408211 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9690210-8756-411d-97f4-82328f3407bb None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:19.408496 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9690210-8756-411d-97f4-82328f3407bb None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:19.408773 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9690210-8756-411d-97f4-82328f3407bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:19.409581 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9690210-8756-411d-97f4-82328f3407bb None admin] RBAC: Adding query filter params (interface=public, service_id=7207736713ed4549a41524cb6b03c793, region_id=RegionOne) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:06:19.409902 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9690210-8756-411d-97f4-82328f3407bb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:19.411332 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9690210-8756-411d-97f4-82328f3407bb None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:19.417498 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 457/921] 10.222.0.39 () {56 vars in 1251 bytes} [Wed May 25 15:06:19 2022] GET /identity/v3/endpoints?service_id=7207736713ed4549a41524cb6b03c793&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:06:19.423785 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078dc81f-cd02-4e5e-b0c4-78453583c442 None admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:19.521670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:19.542086 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078dc81f-cd02-4e5e-b0c4-78453583c442 None admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:19.580858 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3566263-14a9-4e25-bb34-770500a933b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:19.581664 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3566263-14a9-4e25-bb34-770500a933b2 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:19.582043 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3566263-14a9-4e25-bb34-770500a933b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:19.582451 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3566263-14a9-4e25-bb34-770500a933b2 None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:19.583256 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3566263-14a9-4e25-bb34-770500a933b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:19.584751 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3566263-14a9-4e25-bb34-770500a933b2 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:19.591995 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 465/922] 10.222.0.39 () {56 vars in 1087 bytes} [Wed May 25 15:06:19 2022] GET /identity/v3/services => generated 1962 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:06:21.983704 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09666711-e4b9-486d-bc6e-5e52e559ad37 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:21.984263 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09666711-e4b9-486d-bc6e-5e52e559ad37 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:21.984263 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09666711-e4b9-486d-bc6e-5e52e559ad37 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:21.985617 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 458/923] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:06:21.991222 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba4a55-6ac5-4659-a455-79688534a3bc None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:21.991794 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba4a55-6ac5-4659-a455-79688534a3bc None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:21.991794 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba4a55-6ac5-4659-a455-79688534a3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:22.009619 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-b7ba4a55-6ac5-4659-a455-79688534a3bc None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:06:22.010882 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-b7ba4a55-6ac5-4659-a455-79688534a3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:06:22.083161 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 466/924] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:06:21 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:06:22.107852 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09666711-e4b9-486d-bc6e-5e52e559ad37 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:22.217730 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:22.229133 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09666711-e4b9-486d-bc6e-5e52e559ad37 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:22.266304 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d392b-23fe-4d3b-b1c3-e936e49958a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:22.266829 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d392b-23fe-4d3b-b1c3-e936e49958a5 None admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:22.267047 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d392b-23fe-4d3b-b1c3-e936e49958a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:22.267317 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d392b-23fe-4d3b-b1c3-e936e49958a5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:22.267971 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d392b-23fe-4d3b-b1c3-e936e49958a5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:22.269432 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d392b-23fe-4d3b-b1c3-e936e49958a5 None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:22.282064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application [None req-380d392b-23fe-4d3b-b1c3-e936e49958a5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:06:22.282064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:06:22.282064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:06:22.282064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:06:22.282064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:06:22.282064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:06:22.282064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:06:22.282064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:06:22.282064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:06:22.282064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:06:22.282064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:06:22.282064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:06:22.282064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:06:22.282064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:06:22.282064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:06:22.282064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:06:22.282064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:06:22.283830 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:06:22.283830 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:06:22.283830 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:06:22.283830 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:06:22.283830 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:06:22.283830 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:06:22.283830 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:06:22.283830 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:06:22.283830 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:06:22.283830 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:06:22.283830 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:06:22.283830 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:06:22.283830 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:06:22.283830 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:06:22.283830 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:06:22.283830 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:06:22.285499 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:06:22.285499 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application with Lock( May 25 15:06:22.285499 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:06:22.285499 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self._enter() May 25 15:06:22.285499 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:06:22.285499 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:06:22.285499 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:06:22.285499 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application return self.creator() May 25 15:06:22.285499 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:06:22.285499 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application created_value = creator( May 25 15:06:22.285499 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:06:22.285499 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:06:22.285499 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:06:22.285499 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: ERROR keystone.server.flask.application May 25 15:06:22.285499 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 459/925] 10.222.0.39 () {56 vars in 1117 bytes} [Wed May 25 15:06:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:06:22.294637 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba4a55-6ac5-4659-a455-79688534a3bc None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:22.381475 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:22.408250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba4a55-6ac5-4659-a455-79688534a3bc None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:22.445631 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1a659-9248-42ab-9c21-8eafb60d0d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:22.446319 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1a659-9248-42ab-9c21-8eafb60d0d07 None admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:22.446620 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1a659-9248-42ab-9c21-8eafb60d0d07 None admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:22.446864 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1a659-9248-42ab-9c21-8eafb60d0d07 None admin] PATH_INFO: `/v3/services` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:22.447601 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1a659-9248-42ab-9c21-8eafb60d0d07 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:06:22.447911 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1a659-9248-42ab-9c21-8eafb60d0d07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:22.449294 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1a659-9248-42ab-9c21-8eafb60d0d07 None admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:22.455539 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 467/926] 10.222.0.39 () {56 vars in 1116 bytes} [Wed May 25 15:06:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:06:22.461709 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d392b-23fe-4d3b-b1c3-e936e49958a5 None admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:06:22.585504 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d392b-23fe-4d3b-b1c3-e936e49958a5 None admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:06:22.621836 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91b2bc-8bd9-41b0-80bf-81cfbaf19d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:06:22.622579 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91b2bc-8bd9-41b0-80bf-81cfbaf19d0e None admin] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:06:22.622868 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91b2bc-8bd9-41b0-80bf-81cfbaf19d0e None admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:06:22.623141 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91b2bc-8bd9-41b0-80bf-81cfbaf19d0e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:06:22.627061 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91b2bc-8bd9-41b0-80bf-81cfbaf19d0e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:06:22.627061 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91b2bc-8bd9-41b0-80bf-81cfbaf19d0e None admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:06:22.647263 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 460/927] 10.222.0.39 () {60 vars in 1144 bytes} [Wed May 25 15:06:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:06:32.452308 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=30 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:06:32.641726 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:28.538886 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77122e88-abdf-486b-b5c1-ae9ea997ca06 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:28.539401 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77122e88-abdf-486b-b5c1-ae9ea997ca06 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:28.539849 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77122e88-abdf-486b-b5c1-ae9ea997ca06 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:28.542638 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 468/928] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:07:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:28.550058 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c9f19-7697-44b3-8c4c-3b676f25f9d7 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:28.550780 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c9f19-7697-44b3-8c4c-3b676f25f9d7 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:28.550780 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c9f19-7697-44b3-8c4c-3b676f25f9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:28.584852 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-e37c9f19-7697-44b3-8c4c-3b676f25f9d7 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:28.586962 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-e37c9f19-7697-44b3-8c4c-3b676f25f9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:28.708823 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 461/929] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:07:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:28.788564 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa40ec-9716-4f0f-911b-c564214d77ea None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:28.789187 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa40ec-9716-4f0f-911b-c564214d77ea None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:28.789850 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa40ec-9716-4f0f-911b-c564214d77ea None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:28.792713 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 469/930] 10.222.0.39 () {54 vars in 964 bytes} [Wed May 25 15:07:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:28.799962 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc720070-f763-4eda-b18f-c90c12815f30 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:28.800364 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc720070-f763-4eda-b18f-c90c12815f30 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:28.800560 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc720070-f763-4eda-b18f-c90c12815f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:28.866159 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-cc720070-f763-4eda-b18f-c90c12815f30 None None] MFA Rules not processed for user `f22ed37eb4a04bd4ad58739434623a48`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:28.867337 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-cc720070-f763-4eda-b18f-c90c12815f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:28.944388 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 462/931] 10.222.0.39 () {58 vars in 1061 bytes} [Wed May 25 15:07:28 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:28.956565 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa40ec-9716-4f0f-911b-c564214d77ea None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:28.976034 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa40ec-9716-4f0f-911b-c564214d77ea None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:28.982797 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657747f1-7eb3-43c3-b6c4-42715c3d1d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:28.984285 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657747f1-7eb3-43c3-b6c4-42715c3d1d78 service neutron] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:28.985049 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657747f1-7eb3-43c3-b6c4-42715c3d1d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:28.985844 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657747f1-7eb3-43c3-b6c4-42715c3d1d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:29.004395 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657747f1-7eb3-43c3-b6c4-42715c3d1d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:29.007650 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657747f1-7eb3-43c3-b6c4-42715c3d1d78 service neutron] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:29.027444 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 470/932] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:07:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:32.045942 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf921d-7200-42bd-be4d-16d4f5111e3e None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:32.046537 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf921d-7200-42bd-be4d-16d4f5111e3e None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:32.046801 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf921d-7200-42bd-be4d-16d4f5111e3e None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:32.054619 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a197c8-ba34-4133-af69-ef24ff0e357f None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:32.055461 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a197c8-ba34-4133-af69-ef24ff0e357f None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:32.055461 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a197c8-ba34-4133-af69-ef24ff0e357f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:32.058742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 463/933] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:07:32 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:32.076611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-41a197c8-ba34-4133-af69-ef24ff0e357f None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:32.078142 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-41a197c8-ba34-4133-af69-ef24ff0e357f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:32.086961 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 471/934] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:07:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:32.143988 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d6276-d83a-47eb-a709-a48008e586c5 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:32.144300 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d6276-d83a-47eb-a709-a48008e586c5 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:32.144623 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d6276-d83a-47eb-a709-a48008e586c5 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:32.146342 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 464/935] 10.222.0.39 () {54 vars in 964 bytes} [Wed May 25 15:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:07:32.153197 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da8dad-a9cb-42e8-84c8-6a3800c4613c None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:32.153685 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da8dad-a9cb-42e8-84c8-6a3800c4613c None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:32.154131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da8dad-a9cb-42e8-84c8-6a3800c4613c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:32.176250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-12da8dad-a9cb-42e8-84c8-6a3800c4613c None None] MFA Rules not processed for user `f22ed37eb4a04bd4ad58739434623a48`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:32.177633 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-12da8dad-a9cb-42e8-84c8-6a3800c4613c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:32.185223 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 472/936] 10.222.0.39 () {58 vars in 1061 bytes} [Wed May 25 15:07:32 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:32.194575 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d6276-d83a-47eb-a709-a48008e586c5 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:32.207325 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d6276-d83a-47eb-a709-a48008e586c5 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:32.212905 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ec806-9a4a-4877-b2d7-0ebf08363a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:32.213894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ec806-9a4a-4877-b2d7-0ebf08363a45 service neutron] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:32.214387 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ec806-9a4a-4877-b2d7-0ebf08363a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:32.214713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ec806-9a4a-4877-b2d7-0ebf08363a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:32.228260 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ec806-9a4a-4877-b2d7-0ebf08363a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:32.230327 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ec806-9a4a-4877-b2d7-0ebf08363a45 service neutron] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:32.248924 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 465/937] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:07:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:35.147969 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd272c-35b9-42d1-bed3-50fee8719d0a None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:35.148708 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd272c-35b9-42d1-bed3-50fee8719d0a None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:35.148708 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd272c-35b9-42d1-bed3-50fee8719d0a None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:35.149915 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 473/938] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:35.157466 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e09655-d8e7-44b3-8f4e-c46afbc92ea7 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:35.158281 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e09655-d8e7-44b3-8f4e-c46afbc92ea7 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:35.158281 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e09655-d8e7-44b3-8f4e-c46afbc92ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:35.205578 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-06e09655-d8e7-44b3-8f4e-c46afbc92ea7 None None] MFA Rules not processed for user `59ac1efaf68a45108260a4d69c510080`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:35.206831 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-06e09655-d8e7-44b3-8f4e-c46afbc92ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:35.251569 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:35.281981 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 466/939] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:07:35 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:35.325032 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd272c-35b9-42d1-bed3-50fee8719d0a None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:35.336184 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd272c-35b9-42d1-bed3-50fee8719d0a None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:35.339683 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff0eba-0160-4ecb-b586-a46c0e7304af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:35.340471 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff0eba-0160-4ecb-b586-a46c0e7304af service neutron] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:35.340861 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff0eba-0160-4ecb-b586-a46c0e7304af service neutron] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:35.341142 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff0eba-0160-4ecb-b586-a46c0e7304af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:35.352762 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff0eba-0160-4ecb-b586-a46c0e7304af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:35.354407 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff0eba-0160-4ecb-b586-a46c0e7304af service neutron] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:35.365743 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 474/940] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:07:35 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:38.500049 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c3f56-f5f7-400f-9c3b-28244b192ecb None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:38.500610 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c3f56-f5f7-400f-9c3b-28244b192ecb None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:38.500610 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c3f56-f5f7-400f-9c3b-28244b192ecb None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:38.501990 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 467/941] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:38.508883 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0859e88-6552-4129-a090-c3ef6e26732c None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:38.509465 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0859e88-6552-4129-a090-c3ef6e26732c None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:38.509465 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0859e88-6552-4129-a090-c3ef6e26732c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:38.531085 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-e0859e88-6552-4129-a090-c3ef6e26732c None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:38.532346 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-e0859e88-6552-4129-a090-c3ef6e26732c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:38.615657 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 475/942] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:07:38 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:38.657187 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c3f56-f5f7-400f-9c3b-28244b192ecb None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:38.669272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c3f56-f5f7-400f-9c3b-28244b192ecb None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:38.673746 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2941e-7564-4c2b-bf2d-60b773c311dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:38.674452 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2941e-7564-4c2b-bf2d-60b773c311dd service neutron] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:38.674746 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2941e-7564-4c2b-bf2d-60b773c311dd service neutron] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:38.675016 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2941e-7564-4c2b-bf2d-60b773c311dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:38.686232 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2941e-7564-4c2b-bf2d-60b773c311dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:38.687742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2941e-7564-4c2b-bf2d-60b773c311dd service neutron] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:38.698953 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 468/943] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:07:38 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:41.806390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae19e9-c861-4e81-9cd5-3be3101cdeaf None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:41.806390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae19e9-c861-4e81-9cd5-3be3101cdeaf None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:41.806390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae19e9-c861-4e81-9cd5-3be3101cdeaf None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:41.806390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 476/944] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:07:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:41.813965 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5d219-b9ab-4c72-bee3-608870c2d824 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:41.815069 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5d219-b9ab-4c72-bee3-608870c2d824 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:41.815069 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5d219-b9ab-4c72-bee3-608870c2d824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:41.834139 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-68b5d219-b9ab-4c72-bee3-608870c2d824 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:41.835429 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-68b5d219-b9ab-4c72-bee3-608870c2d824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:41.843591 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 469/945] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:07:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:07:41.905453 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae19e9-c861-4e81-9cd5-3be3101cdeaf None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:41.916598 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae19e9-c861-4e81-9cd5-3be3101cdeaf None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:41.920405 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f03728-f832-4307-a585-88e7cff73f18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:41.921133 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f03728-f832-4307-a585-88e7cff73f18 service neutron] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:41.921412 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f03728-f832-4307-a585-88e7cff73f18 service neutron] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:41.921684 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f03728-f832-4307-a585-88e7cff73f18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:41.932649 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f03728-f832-4307-a585-88e7cff73f18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:41.935166 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f03728-f832-4307-a585-88e7cff73f18 service neutron] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:41.948299 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 477/946] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:07:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:44.359308 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53e7bd-612a-42b9-b03d-7bf663950895 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:44.360268 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53e7bd-612a-42b9-b03d-7bf663950895 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:44.360549 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53e7bd-612a-42b9-b03d-7bf663950895 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:44.362022 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 470/947] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:07:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:44.371056 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70904b7-2ee5-4e16-b8ad-1d73c46ecd13 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:44.371677 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70904b7-2ee5-4e16-b8ad-1d73c46ecd13 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:44.372334 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70904b7-2ee5-4e16-b8ad-1d73c46ecd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:44.401034 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-d70904b7-2ee5-4e16-b8ad-1d73c46ecd13 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:44.402848 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-d70904b7-2ee5-4e16-b8ad-1d73c46ecd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:44.415798 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 478/948] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:07:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:44.462650 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53e7bd-612a-42b9-b03d-7bf663950895 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:44.475161 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53e7bd-612a-42b9-b03d-7bf663950895 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:44.479375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc511002-29bd-4613-a0ca-73af98586bba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:44.480042 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc511002-29bd-4613-a0ca-73af98586bba service neutron] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:44.480329 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc511002-29bd-4613-a0ca-73af98586bba service neutron] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:44.480616 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc511002-29bd-4613-a0ca-73af98586bba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:44.491173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc511002-29bd-4613-a0ca-73af98586bba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:44.492639 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc511002-29bd-4613-a0ca-73af98586bba service neutron] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:44.504398 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 471/949] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:07:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:07:46.868221 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581fefc-6a9e-49d9-93a5-5d6fcfe9f8e1 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:46.868801 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581fefc-6a9e-49d9-93a5-5d6fcfe9f8e1 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:46.868801 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581fefc-6a9e-49d9-93a5-5d6fcfe9f8e1 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:46.870150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 479/950] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:46.877285 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05a8f1-3dd0-42c4-a016-7a3ebb3787a3 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:46.877843 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05a8f1-3dd0-42c4-a016-7a3ebb3787a3 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:46.877999 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05a8f1-3dd0-42c4-a016-7a3ebb3787a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:46.899831 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-cb05a8f1-3dd0-42c4-a016-7a3ebb3787a3 None None] MFA Rules not processed for user `59ac1efaf68a45108260a4d69c510080`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:46.900953 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-cb05a8f1-3dd0-42c4-a016-7a3ebb3787a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:46.909964 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 472/951] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:07:46 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:46.949876 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581fefc-6a9e-49d9-93a5-5d6fcfe9f8e1 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:46.962722 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581fefc-6a9e-49d9-93a5-5d6fcfe9f8e1 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:46.967269 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0db901-8dc1-420f-aaf7-da036291a00c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:46.968029 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0db901-8dc1-420f-aaf7-da036291a00c service neutron] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:46.968315 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0db901-8dc1-420f-aaf7-da036291a00c service neutron] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:46.968592 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0db901-8dc1-420f-aaf7-da036291a00c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:46.982668 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0db901-8dc1-420f-aaf7-da036291a00c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:46.985411 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0db901-8dc1-420f-aaf7-da036291a00c service neutron] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:47.003500 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 480/952] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:07:46 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:07:50.076051 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bc7fe-faa0-46a9-9ab2-ccefaeea4079 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:50.076666 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bc7fe-faa0-46a9-9ab2-ccefaeea4079 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:50.076666 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bc7fe-faa0-46a9-9ab2-ccefaeea4079 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:50.078028 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 473/953] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:50.083994 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d265e-1ca8-4d9c-8beb-b375985c144c None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:50.084500 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d265e-1ca8-4d9c-8beb-b375985c144c None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:50.084701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d265e-1ca8-4d9c-8beb-b375985c144c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:50.105451 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-5c2d265e-1ca8-4d9c-8beb-b375985c144c None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:50.107009 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-5c2d265e-1ca8-4d9c-8beb-b375985c144c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:50.116802 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 481/954] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:07:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:50.155975 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bc7fe-faa0-46a9-9ab2-ccefaeea4079 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:50.168182 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bc7fe-faa0-46a9-9ab2-ccefaeea4079 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:50.172214 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b798f2-ea74-4ef9-98f7-05e84e876768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:50.172877 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b798f2-ea74-4ef9-98f7-05e84e876768 service neutron] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:50.173155 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b798f2-ea74-4ef9-98f7-05e84e876768 service neutron] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:50.173429 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b798f2-ea74-4ef9-98f7-05e84e876768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:50.184092 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b798f2-ea74-4ef9-98f7-05e84e876768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:50.185542 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b798f2-ea74-4ef9-98f7-05e84e876768 service neutron] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:50.196665 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 474/955] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:07:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:52.591088 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9db10d-2348-4ebb-a431-3b54631e44f4 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:52.591658 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9db10d-2348-4ebb-a431-3b54631e44f4 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:52.591658 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9db10d-2348-4ebb-a431-3b54631e44f4 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:52.593141 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 482/956] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:52.599385 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20cc56-904e-4bf6-9019-507831439087 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:52.599837 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20cc56-904e-4bf6-9019-507831439087 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:52.599938 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20cc56-904e-4bf6-9019-507831439087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:52.621198 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-8f20cc56-904e-4bf6-9019-507831439087 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:52.623464 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-8f20cc56-904e-4bf6-9019-507831439087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:52.631850 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 475/957] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:07:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:52.674747 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9db10d-2348-4ebb-a431-3b54631e44f4 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:52.680470 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=68 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:07:52.687556 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9db10d-2348-4ebb-a431-3b54631e44f4 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:52.691938 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e63fff-6ab5-46c2-909c-3d8cbaf263f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:52.692612 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e63fff-6ab5-46c2-909c-3d8cbaf263f4 service neutron] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:52.692892 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e63fff-6ab5-46c2-909c-3d8cbaf263f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:52.693164 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e63fff-6ab5-46c2-909c-3d8cbaf263f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:52.704393 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e63fff-6ab5-46c2-909c-3d8cbaf263f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:52.705865 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e63fff-6ab5-46c2-909c-3d8cbaf263f4 service neutron] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:52.717514 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 483/958] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:07:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:55.524038 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9a707-bf1e-404d-94da-28aa5f33497d None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:55.524844 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9a707-bf1e-404d-94da-28aa5f33497d None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:55.524844 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9a707-bf1e-404d-94da-28aa5f33497d None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:55.526267 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 476/959] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:55.532666 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc27607-7152-4ba9-8290-d9952444ac7d None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:55.533273 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc27607-7152-4ba9-8290-d9952444ac7d None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:55.533273 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc27607-7152-4ba9-8290-d9952444ac7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:55.555637 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-ffc27607-7152-4ba9-8290-d9952444ac7d None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:07:55.556898 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-ffc27607-7152-4ba9-8290-d9952444ac7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:07:55.566954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 484/960] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:07:55 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:07:55.607988 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9a707-bf1e-404d-94da-28aa5f33497d None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:07:55.622276 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9a707-bf1e-404d-94da-28aa5f33497d None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:07:55.626485 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab993df-e782-42e9-b486-2360ab57ccc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:07:55.627139 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab993df-e782-42e9-b486-2360ab57ccc8 service neutron] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:55.627429 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab993df-e782-42e9-b486-2360ab57ccc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:55.627707 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab993df-e782-42e9-b486-2360ab57ccc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:55.637808 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab993df-e782-42e9-b486-2360ab57ccc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:07:55.638934 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab993df-e782-42e9-b486-2360ab57ccc8 service neutron] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:07:55.649007 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 477/961] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:07:55 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:07:59.977670 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfb8b0-2aac-4ce9-bd56-bc9d29455587 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:59.978200 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfb8b0-2aac-4ce9-bd56-bc9d29455587 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:59.978200 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfb8b0-2aac-4ce9-bd56-bc9d29455587 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:07:59.979651 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 485/962] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:07:59.985368 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ca036-93cb-4d14-aab1-932a4e34914b None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:07:59.985834 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ca036-93cb-4d14-aab1-932a4e34914b None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:07:59.985927 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ca036-93cb-4d14-aab1-932a4e34914b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:00.004406 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-cf7ca036-93cb-4d14-aab1-932a4e34914b None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:00.005508 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-cf7ca036-93cb-4d14-aab1-932a4e34914b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:00.013828 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 478/963] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:07:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:00.054020 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bfb8b0-2aac-4ce9-bd56-bc9d29455587 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:00.065914 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bfb8b0-2aac-4ce9-bd56-bc9d29455587 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:00.069727 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee647a-8127-48af-9596-7f2f008e0b76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:00.070392 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee647a-8127-48af-9596-7f2f008e0b76 service neutron] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:00.070662 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee647a-8127-48af-9596-7f2f008e0b76 service neutron] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:00.070949 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee647a-8127-48af-9596-7f2f008e0b76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:00.080922 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee647a-8127-48af-9596-7f2f008e0b76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:00.082407 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee647a-8127-48af-9596-7f2f008e0b76 service neutron] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:00.092496 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 486/964] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:08:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:02.978041 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605e7a2-6c0e-48ec-9a48-74820ce4a118 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:02.978603 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605e7a2-6c0e-48ec-9a48-74820ce4a118 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:02.978692 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605e7a2-6c0e-48ec-9a48-74820ce4a118 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:02.980238 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 479/965] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:02.985932 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58a484-eeea-4275-930f-d8e6be0f4d8c None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:02.986336 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58a484-eeea-4275-930f-d8e6be0f4d8c None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:02.986537 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58a484-eeea-4275-930f-d8e6be0f4d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:03.006230 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-ed58a484-eeea-4275-930f-d8e6be0f4d8c None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:03.007467 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-ed58a484-eeea-4275-930f-d8e6be0f4d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:03.016975 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 487/966] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:08:02 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:03.054954 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605e7a2-6c0e-48ec-9a48-74820ce4a118 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:03.067082 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605e7a2-6c0e-48ec-9a48-74820ce4a118 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:03.071508 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1e4a8-7462-4d36-b4d3-5a9308a30133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:03.072246 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1e4a8-7462-4d36-b4d3-5a9308a30133 service neutron] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:03.072537 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1e4a8-7462-4d36-b4d3-5a9308a30133 service neutron] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:03.072805 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1e4a8-7462-4d36-b4d3-5a9308a30133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:03.083983 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1e4a8-7462-4d36-b4d3-5a9308a30133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:03.085429 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1e4a8-7462-4d36-b4d3-5a9308a30133 service neutron] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:03.096161 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 480/967] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:08:03 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:07.500355 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308dc891-cbde-45af-b644-bf9c545901e7 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:07.500908 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308dc891-cbde-45af-b644-bf9c545901e7 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:07.500908 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308dc891-cbde-45af-b644-bf9c545901e7 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:07.502272 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 488/968] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:07.508095 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326efad1-07af-4abe-8190-cc1d7bdc58ba None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:07.508527 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326efad1-07af-4abe-8190-cc1d7bdc58ba None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:07.508649 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326efad1-07af-4abe-8190-cc1d7bdc58ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:07.516531 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=54 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:07.532068 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-326efad1-07af-4abe-8190-cc1d7bdc58ba None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:07.533314 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-326efad1-07af-4abe-8190-cc1d7bdc58ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:07.541983 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 481/969] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:08:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:07.584095 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308dc891-cbde-45af-b644-bf9c545901e7 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:07.597022 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308dc891-cbde-45af-b644-bf9c545901e7 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:07.600943 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90857db0-4d26-433b-8574-75ac5fb7e962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:07.601603 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90857db0-4d26-433b-8574-75ac5fb7e962 service neutron] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:07.601888 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90857db0-4d26-433b-8574-75ac5fb7e962 service neutron] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:07.602168 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90857db0-4d26-433b-8574-75ac5fb7e962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:07.613494 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90857db0-4d26-433b-8574-75ac5fb7e962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:07.615065 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90857db0-4d26-433b-8574-75ac5fb7e962 service neutron] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:07.626153 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 489/970] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:08:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:13.320018 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc743a6-cdc9-4c74-89c0-b392f3dd426f None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:13.321008 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc743a6-cdc9-4c74-89c0-b392f3dd426f None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:13.321485 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc743a6-cdc9-4c74-89c0-b392f3dd426f None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:13.323374 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 482/971] 10.222.0.39 () {54 vars in 921 bytes} [Wed May 25 15:08:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:13.329430 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a3f4e-3af9-4124-aac3-2256c2c44e64 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:13.330433 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a3f4e-3af9-4124-aac3-2256c2c44e64 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:13.330911 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a3f4e-3af9-4124-aac3-2256c2c44e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:13.382433 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-597a3f4e-3af9-4124-aac3-2256c2c44e64 None None] MFA Rules not processed for user `b28b47418d054fe091d379d83a30db11`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:13.383981 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-597a3f4e-3af9-4124-aac3-2256c2c44e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:13.494709 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 490/972] 10.222.0.39 () {58 vars in 1018 bytes} [Wed May 25 15:08:13 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:17.524387 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=2 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:17.966867 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a0d93-cb73-4938-ba31-8aa110abff8a None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:17.967702 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a0d93-cb73-4938-ba31-8aa110abff8a None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:17.968372 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a0d93-cb73-4938-ba31-8aa110abff8a None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:17.970742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 483/973] 10.222.0.39 () {54 vars in 921 bytes} [Wed May 25 15:08:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:17.981493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63538eff-a3d8-4c8e-a48b-445e02a5df02 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:17.982057 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63538eff-a3d8-4c8e-a48b-445e02a5df02 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:17.982495 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63538eff-a3d8-4c8e-a48b-445e02a5df02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:18.001564 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-63538eff-a3d8-4c8e-a48b-445e02a5df02 None None] MFA Rules not processed for user `b28b47418d054fe091d379d83a30db11`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:18.002812 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-63538eff-a3d8-4c8e-a48b-445e02a5df02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:18.011548 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 491/974] 10.222.0.39 () {58 vars in 1018 bytes} [Wed May 25 15:08:17 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:19.453704 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6942ae-73d4-4d63-826e-e98fbfea0822 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:19.454174 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6942ae-73d4-4d63-826e-e98fbfea0822 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:19.454390 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6942ae-73d4-4d63-826e-e98fbfea0822 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:19.455606 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 484/975] 10.222.0.39 () {54 vars in 921 bytes} [Wed May 25 15:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:19.460901 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ba790-2b88-45aa-8a30-3c8d889f3b71 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:19.461402 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ba790-2b88-45aa-8a30-3c8d889f3b71 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:19.461773 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ba790-2b88-45aa-8a30-3c8d889f3b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:19.483696 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-6a7ba790-2b88-45aa-8a30-3c8d889f3b71 None None] MFA Rules not processed for user `b28b47418d054fe091d379d83a30db11`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:19.485052 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-6a7ba790-2b88-45aa-8a30-3c8d889f3b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:19.494405 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 492/976] 10.222.0.39 () {58 vars in 1018 bytes} [Wed May 25 15:08:19 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:23.655265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a36802-f29c-4446-b51a-9de75f6e39c3 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:23.655778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a36802-f29c-4446-b51a-9de75f6e39c3 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:23.655778 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a36802-f29c-4446-b51a-9de75f6e39c3 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:23.661640 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 485/977] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:08:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:23.662879 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce848043-7b51-4dcf-9657-a51aee816a8e None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:23.664002 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce848043-7b51-4dcf-9657-a51aee816a8e None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:23.664504 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce848043-7b51-4dcf-9657-a51aee816a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:23.672575 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=69 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:23.686796 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-ce848043-7b51-4dcf-9657-a51aee816a8e None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:23.688429 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-ce848043-7b51-4dcf-9657-a51aee816a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:23.696960 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 493/978] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:08:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:08:23.758640 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9347498-2af8-431a-b961-b7d7803d41f1 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:23.760405 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9347498-2af8-431a-b961-b7d7803d41f1 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:23.761380 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9347498-2af8-431a-b961-b7d7803d41f1 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:23.765144 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 486/979] 10.222.0.39 () {54 vars in 961 bytes} [Wed May 25 15:08:23 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:23.775916 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9920673-81b4-46d8-b565-c7f3c3754624 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:23.777004 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9920673-81b4-46d8-b565-c7f3c3754624 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:23.777792 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9920673-81b4-46d8-b565-c7f3c3754624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:23.845959 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-c9920673-81b4-46d8-b565-c7f3c3754624 None None] MFA Rules not processed for user `33f6a22c123f48a09af2f78636a04699`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:23.848576 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-c9920673-81b4-46d8-b565-c7f3c3754624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:23.931183 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 494/980] 10.222.0.39 () {58 vars in 1058 bytes} [Wed May 25 15:08:23 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:23.940452 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9347498-2af8-431a-b961-b7d7803d41f1 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:23.957757 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9347498-2af8-431a-b961-b7d7803d41f1 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:23.966506 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1db27-8ca7-46a1-ab8c-eeb9dad65a99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:23.967662 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1db27-8ca7-46a1-ab8c-eeb9dad65a99 service nova] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:23.968147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1db27-8ca7-46a1-ab8c-eeb9dad65a99 service nova] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:23.968621 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1db27-8ca7-46a1-ab8c-eeb9dad65a99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:23.984402 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1db27-8ca7-46a1-ab8c-eeb9dad65a99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:23.987713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1db27-8ca7-46a1-ab8c-eeb9dad65a99 service nova] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:24.003995 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 487/981] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:08:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:26.515610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bb122-2768-473d-8eae-443dbf77abb2 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:26.516185 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bb122-2768-473d-8eae-443dbf77abb2 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:26.516185 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bb122-2768-473d-8eae-443dbf77abb2 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:26.517702 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 495/982] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:26.523010 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3894d-a69f-49a3-b3cb-a85bb5b9f4cf None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:26.523484 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3894d-a69f-49a3-b3cb-a85bb5b9f4cf None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:26.523580 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3894d-a69f-49a3-b3cb-a85bb5b9f4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:26.542144 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-84d3894d-a69f-49a3-b3cb-a85bb5b9f4cf None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:26.543374 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-84d3894d-a69f-49a3-b3cb-a85bb5b9f4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:26.552156 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 488/983] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:08:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:26.602842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bb122-2768-473d-8eae-443dbf77abb2 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:26.625147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bb122-2768-473d-8eae-443dbf77abb2 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:26.633271 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ca596-ed14-44e6-8f93-f7326c2d2fb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:26.634463 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ca596-ed14-44e6-8f93-f7326c2d2fb3 service nova] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:26.634960 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ca596-ed14-44e6-8f93-f7326c2d2fb3 service nova] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:26.635451 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ca596-ed14-44e6-8f93-f7326c2d2fb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:26.651129 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ca596-ed14-44e6-8f93-f7326c2d2fb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:26.654155 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ca596-ed14-44e6-8f93-f7326c2d2fb3 service nova] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:26.672782 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 496/984] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:08:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:29.366008 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7936b-9b7a-4b41-99f8-69c15fe66b6a None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:29.367012 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7936b-9b7a-4b41-99f8-69c15fe66b6a None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:29.367535 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7936b-9b7a-4b41-99f8-69c15fe66b6a None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:29.369191 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 489/985] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:08:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:08:29.375206 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631a0e0-4812-41ef-8bad-f18c1bbaeef8 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:29.375701 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631a0e0-4812-41ef-8bad-f18c1bbaeef8 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:29.375799 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631a0e0-4812-41ef-8bad-f18c1bbaeef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:29.393955 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-f631a0e0-4812-41ef-8bad-f18c1bbaeef8 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:29.395220 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-f631a0e0-4812-41ef-8bad-f18c1bbaeef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:29.403386 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 497/986] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:08:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:29.452446 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39e3bf-70c8-4ae5-96e3-fdb455d41021 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:29.452741 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39e3bf-70c8-4ae5-96e3-fdb455d41021 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:29.453061 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39e3bf-70c8-4ae5-96e3-fdb455d41021 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:29.454779 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 490/987] 10.222.0.39 () {54 vars in 961 bytes} [Wed May 25 15:08:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:29.461758 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7696ee5-5f76-4abf-ac4c-0901efce8de9 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:29.462075 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7696ee5-5f76-4abf-ac4c-0901efce8de9 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:29.462353 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7696ee5-5f76-4abf-ac4c-0901efce8de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:29.483671 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-f7696ee5-5f76-4abf-ac4c-0901efce8de9 None None] MFA Rules not processed for user `33f6a22c123f48a09af2f78636a04699`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:29.484889 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-f7696ee5-5f76-4abf-ac4c-0901efce8de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:29.494075 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 498/988] 10.222.0.39 () {58 vars in 1058 bytes} [Wed May 25 15:08:29 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:29.501898 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39e3bf-70c8-4ae5-96e3-fdb455d41021 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:29.517265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39e3bf-70c8-4ae5-96e3-fdb455d41021 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:29.522457 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd52a2c-b192-4e08-a265-16b7030d1fa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:29.523107 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd52a2c-b192-4e08-a265-16b7030d1fa7 service nova] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:29.523385 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd52a2c-b192-4e08-a265-16b7030d1fa7 service nova] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:29.523668 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd52a2c-b192-4e08-a265-16b7030d1fa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:29.532966 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd52a2c-b192-4e08-a265-16b7030d1fa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:29.534676 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd52a2c-b192-4e08-a265-16b7030d1fa7 service nova] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:29.545524 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 491/989] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:08:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:31.979660 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda46158-fb32-4516-8717-15271b142530 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:31.980576 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda46158-fb32-4516-8717-15271b142530 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:31.981013 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda46158-fb32-4516-8717-15271b142530 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:31.983387 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 499/990] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:08:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:31.989213 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9b83c-4be4-4825-9400-ea3e01d861c2 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:31.990039 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9b83c-4be4-4825-9400-ea3e01d861c2 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:31.990506 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9b83c-4be4-4825-9400-ea3e01d861c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:32.010746 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-c4a9b83c-4be4-4825-9400-ea3e01d861c2 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:32.012217 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-c4a9b83c-4be4-4825-9400-ea3e01d861c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:32.026629 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 492/991] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:08:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:32.072202 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda46158-fb32-4516-8717-15271b142530 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:32.087381 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda46158-fb32-4516-8717-15271b142530 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:32.093217 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a4783-0450-4f25-88ec-f437b3c64250 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:32.094138 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a4783-0450-4f25-88ec-f437b3c64250 service nova] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:32.094592 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a4783-0450-4f25-88ec-f437b3c64250 service nova] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:32.095030 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a4783-0450-4f25-88ec-f437b3c64250 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:32.106523 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a4783-0450-4f25-88ec-f437b3c64250 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:32.109082 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a4783-0450-4f25-88ec-f437b3c64250 service nova] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:32.121007 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 500/992] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:08:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:33.830181 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ed040-d61b-4c65-bc2c-1c3e87e77c0e None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:33.830675 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ed040-d61b-4c65-bc2c-1c3e87e77c0e None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:33.830954 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ed040-d61b-4c65-bc2c-1c3e87e77c0e None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:33.833522 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 493/993] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:08:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:33.839130 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cae44-83c3-4e94-81a9-21c014c30d3c None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:33.839532 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cae44-83c3-4e94-81a9-21c014c30d3c None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:33.839756 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cae44-83c3-4e94-81a9-21c014c30d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:33.874881 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-477cae44-83c3-4e94-81a9-21c014c30d3c None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:33.876387 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-477cae44-83c3-4e94-81a9-21c014c30d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:33.894819 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 501/994] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:08:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:34.201628 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14d876-950e-47d4-b64b-ed480f948d5d None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:34.201628 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14d876-950e-47d4-b64b-ed480f948d5d None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:34.201628 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14d876-950e-47d4-b64b-ed480f948d5d None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:34.203348 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 494/995] 10.222.0.39 () {54 vars in 963 bytes} [Wed May 25 15:08:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:34.208037 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234faf06-2f00-4fc6-a1d1-bf12dae27153 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:34.208333 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234faf06-2f00-4fc6-a1d1-bf12dae27153 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:34.208592 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234faf06-2f00-4fc6-a1d1-bf12dae27153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:34.248033 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-234faf06-2f00-4fc6-a1d1-bf12dae27153 None None] MFA Rules not processed for user `57fc08f3464a47faac6390af7bd8a680`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:34.249250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-234faf06-2f00-4fc6-a1d1-bf12dae27153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:34.314968 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 502/996] 10.222.0.39 () {58 vars in 1060 bytes} [Wed May 25 15:08:34 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:08:34.323255 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14d876-950e-47d4-b64b-ed480f948d5d None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:34.335465 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14d876-950e-47d4-b64b-ed480f948d5d None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:34.339827 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0c425-cf02-46d3-87a8-7477c95adfa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57fc08f3464a47faac6390af7bd8a680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:34.340586 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0c425-cf02-46d3-87a8-7477c95adfa8 service cinder] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:34.341067 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0c425-cf02-46d3-87a8-7477c95adfa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:34.341589 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0c425-cf02-46d3-87a8-7477c95adfa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:34.352674 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0c425-cf02-46d3-87a8-7477c95adfa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:34.354357 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0c425-cf02-46d3-87a8-7477c95adfa8 service cinder] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:34.365950 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 495/997] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:08:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:34.559993 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0a6b4-70fa-4755-b8e5-5919c8af3e33 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:34.560744 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0a6b4-70fa-4755-b8e5-5919c8af3e33 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:34.561240 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0a6b4-70fa-4755-b8e5-5919c8af3e33 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:34.562890 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 503/998] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:08:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:34.568697 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aba3ba-2e93-489a-8f1d-8826a418ee4c None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:34.568991 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aba3ba-2e93-489a-8f1d-8826a418ee4c None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:34.569270 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aba3ba-2e93-489a-8f1d-8826a418ee4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:34.587752 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-11aba3ba-2e93-489a-8f1d-8826a418ee4c None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:34.588970 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-11aba3ba-2e93-489a-8f1d-8826a418ee4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:34.598635 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 496/999] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:08:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:34.643889 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0a6b4-70fa-4755-b8e5-5919c8af3e33 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:34.658948 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0a6b4-70fa-4755-b8e5-5919c8af3e33 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:34.664345 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802cd3a-c5ae-485c-a3a9-2b589bb1fd69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:34.665062 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802cd3a-c5ae-485c-a3a9-2b589bb1fd69 service nova] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:34.665355 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802cd3a-c5ae-485c-a3a9-2b589bb1fd69 service nova] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:34.665633 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802cd3a-c5ae-485c-a3a9-2b589bb1fd69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:34.675172 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802cd3a-c5ae-485c-a3a9-2b589bb1fd69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:34.676787 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802cd3a-c5ae-485c-a3a9-2b589bb1fd69 service nova] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:34.680923 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:34.690609 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 504/1000] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:08:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:37.086119 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67c745-42c9-463b-aaab-cdcbf5052865 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:37.086685 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67c745-42c9-463b-aaab-cdcbf5052865 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:37.086685 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67c745-42c9-463b-aaab-cdcbf5052865 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:37.088208 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 497/1001] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:37.093896 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9811bf-eb8b-4a75-b39d-5874bdfd6aab None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:37.094404 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9811bf-eb8b-4a75-b39d-5874bdfd6aab None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:37.094492 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9811bf-eb8b-4a75-b39d-5874bdfd6aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:37.115081 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-0f9811bf-eb8b-4a75-b39d-5874bdfd6aab None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:37.116279 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-0f9811bf-eb8b-4a75-b39d-5874bdfd6aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:37.125187 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 505/1002] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:08:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:37.173110 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67c745-42c9-463b-aaab-cdcbf5052865 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:37.188847 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67c745-42c9-463b-aaab-cdcbf5052865 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:37.194460 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e5c9b-1bc4-4470-ab7a-2010c73b2c9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:37.195276 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e5c9b-1bc4-4470-ab7a-2010c73b2c9b service nova] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:37.195725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e5c9b-1bc4-4470-ab7a-2010c73b2c9b service nova] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:37.196161 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e5c9b-1bc4-4470-ab7a-2010c73b2c9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:37.206029 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e5c9b-1bc4-4470-ab7a-2010c73b2c9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:37.207747 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e5c9b-1bc4-4470-ab7a-2010c73b2c9b service nova] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:37.218507 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 498/1003] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:08:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:39.564193 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2dc70-03f9-4a5c-a24e-8d2f44e360d4 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:39.564736 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2dc70-03f9-4a5c-a24e-8d2f44e360d4 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:39.564736 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2dc70-03f9-4a5c-a24e-8d2f44e360d4 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:39.566111 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 506/1004] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:39.571586 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a970d-b57e-477a-955f-16580e14d431 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:39.572035 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a970d-b57e-477a-955f-16580e14d431 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:39.572144 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a970d-b57e-477a-955f-16580e14d431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:39.594270 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-954a970d-b57e-477a-955f-16580e14d431 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:39.594270 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-954a970d-b57e-477a-955f-16580e14d431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:39.605744 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 499/1005] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:08:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:39.645585 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2dc70-03f9-4a5c-a24e-8d2f44e360d4 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:39.660297 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2dc70-03f9-4a5c-a24e-8d2f44e360d4 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:39.665711 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5808a5-15bd-4a15-a0a5-a7f34d4fae7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:39.666401 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5808a5-15bd-4a15-a0a5-a7f34d4fae7e service nova] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:39.666692 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5808a5-15bd-4a15-a0a5-a7f34d4fae7e service nova] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:39.666970 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5808a5-15bd-4a15-a0a5-a7f34d4fae7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:39.676708 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5808a5-15bd-4a15-a0a5-a7f34d4fae7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:39.678334 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5808a5-15bd-4a15-a0a5-a7f34d4fae7e service nova] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:39.691680 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 507/1006] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:08:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:41.976156 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0390728-e3be-4706-af4d-a4360cf4cbc1 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:41.976750 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0390728-e3be-4706-af4d-a4360cf4cbc1 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:41.976750 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0390728-e3be-4706-af4d-a4360cf4cbc1 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:41.977990 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 500/1007] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:41.986902 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86344c5d-5be7-4dd3-83d5-cd3a78c179e9 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:41.987589 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86344c5d-5be7-4dd3-83d5-cd3a78c179e9 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:41.987752 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86344c5d-5be7-4dd3-83d5-cd3a78c179e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:42.008433 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-86344c5d-5be7-4dd3-83d5-cd3a78c179e9 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:42.010017 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-86344c5d-5be7-4dd3-83d5-cd3a78c179e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:42.019687 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 508/1008] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:08:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:42.069751 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0390728-e3be-4706-af4d-a4360cf4cbc1 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:42.089653 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0390728-e3be-4706-af4d-a4360cf4cbc1 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:42.095702 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094f7a2-50be-4a42-b884-7bbaa92f2c48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:42.096392 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094f7a2-50be-4a42-b884-7bbaa92f2c48 service nova] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:42.096675 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094f7a2-50be-4a42-b884-7bbaa92f2c48 service nova] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:42.096951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094f7a2-50be-4a42-b884-7bbaa92f2c48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:42.108186 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094f7a2-50be-4a42-b884-7bbaa92f2c48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:42.110223 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094f7a2-50be-4a42-b884-7bbaa92f2c48 service nova] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:42.123042 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 501/1009] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:08:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:45.015555 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c860b70-9f11-4caa-89be-bf2e8efd173f None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:45.016134 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c860b70-9f11-4caa-89be-bf2e8efd173f None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:45.016134 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c860b70-9f11-4caa-89be-bf2e8efd173f None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:45.017564 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 509/1010] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:45.024617 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d873afc-215b-4051-b277-d28539709164 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:45.025139 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d873afc-215b-4051-b277-d28539709164 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:45.025233 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d873afc-215b-4051-b277-d28539709164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:45.045933 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-0d873afc-215b-4051-b277-d28539709164 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:45.047232 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-0d873afc-215b-4051-b277-d28539709164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:45.056012 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 502/1011] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:08:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:45.105263 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c860b70-9f11-4caa-89be-bf2e8efd173f None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:45.119753 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c860b70-9f11-4caa-89be-bf2e8efd173f None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:45.126185 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45c468-c753-4766-b7f0-f5f3daf67fa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:45.126828 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45c468-c753-4766-b7f0-f5f3daf67fa6 service nova] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:45.127130 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45c468-c753-4766-b7f0-f5f3daf67fa6 service nova] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:45.127365 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45c468-c753-4766-b7f0-f5f3daf67fa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:45.136995 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45c468-c753-4766-b7f0-f5f3daf67fa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:45.138811 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45c468-c753-4766-b7f0-f5f3daf67fa6 service nova] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:45.150893 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 510/1012] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:08:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:48.426672 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445aabc-959e-4259-bd39-01e6525e27f3 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:48.427316 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445aabc-959e-4259-bd39-01e6525e27f3 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:48.427316 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445aabc-959e-4259-bd39-01e6525e27f3 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:48.428638 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 503/1013] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:48.435399 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc81497-ecc2-4f4a-8bf8-a7efda238c59 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:48.435983 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc81497-ecc2-4f4a-8bf8-a7efda238c59 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:48.436089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc81497-ecc2-4f4a-8bf8-a7efda238c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:48.458563 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-dfc81497-ecc2-4f4a-8bf8-a7efda238c59 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:48.459872 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-dfc81497-ecc2-4f4a-8bf8-a7efda238c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:48.470300 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 511/1014] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:08:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:48.523304 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445aabc-959e-4259-bd39-01e6525e27f3 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:48.533947 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=46 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:08:48.543375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445aabc-959e-4259-bd39-01e6525e27f3 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:48.551391 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8dfbf-8da8-4ae9-bd8c-84603a21165b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:48.552320 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8dfbf-8da8-4ae9-bd8c-84603a21165b service nova] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:48.552656 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8dfbf-8da8-4ae9-bd8c-84603a21165b service nova] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:48.552995 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8dfbf-8da8-4ae9-bd8c-84603a21165b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:48.564069 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8dfbf-8da8-4ae9-bd8c-84603a21165b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:48.565864 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8dfbf-8da8-4ae9-bd8c-84603a21165b service nova] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:48.578992 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 504/1015] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:08:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:08:50.898655 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936272b-e5fc-4c6c-825d-766053be0933 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:50.899372 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936272b-e5fc-4c6c-825d-766053be0933 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:50.899372 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936272b-e5fc-4c6c-825d-766053be0933 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:50.900626 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 512/1016] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:50.907387 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5ef70-dd65-40b0-8aff-f5f9332ddc1f None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:50.908031 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5ef70-dd65-40b0-8aff-f5f9332ddc1f None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:50.908031 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5ef70-dd65-40b0-8aff-f5f9332ddc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:50.927133 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-11f5ef70-dd65-40b0-8aff-f5f9332ddc1f None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:50.928360 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-11f5ef70-dd65-40b0-8aff-f5f9332ddc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:50.937741 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 505/1017] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:08:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:50.953290 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c98fc-c2ad-47a4-a914-054c05231f7c None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:50.953674 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c98fc-c2ad-47a4-a914-054c05231f7c None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:50.954018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963c98fc-c2ad-47a4-a914-054c05231f7c None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:50.955578 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 513/1018] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:50.961761 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb763c7-61d2-4a28-ab60-bae26c70a58d None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:50.962014 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb763c7-61d2-4a28-ab60-bae26c70a58d None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:50.962351 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb763c7-61d2-4a28-ab60-bae26c70a58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:50.982077 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-ebb763c7-61d2-4a28-ab60-bae26c70a58d None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:50.983440 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-ebb763c7-61d2-4a28-ab60-bae26c70a58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:50.991962 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 506/1019] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:08:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:08:51.000787 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a88452-cecf-421b-a3b1-641d44d9ccfe None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:51.001180 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a88452-cecf-421b-a3b1-641d44d9ccfe None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:51.001522 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a88452-cecf-421b-a3b1-641d44d9ccfe None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:51.003167 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 514/1020] 10.222.0.39 () {54 vars in 962 bytes} [Wed May 25 15:08:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:51.008998 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f437f-aa66-4368-a201-67b40d1052ce None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:51.009283 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f437f-aa66-4368-a201-67b40d1052ce None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:51.009571 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f437f-aa66-4368-a201-67b40d1052ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:51.040500 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a88452-cecf-421b-a3b1-641d44d9ccfe None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:51.050673 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-587f437f-aa66-4368-a201-67b40d1052ce None None] MFA Rules not processed for user `2b488bcd5ddc427fbdf78d56793a2035`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:51.051958 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-587f437f-aa66-4368-a201-67b40d1052ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:51.054802 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a88452-cecf-421b-a3b1-641d44d9ccfe None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:51.060805 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d24bc5-aafb-45b9-a95f-23034cad58e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:51.061522 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d24bc5-aafb-45b9-a95f-23034cad58e2 service nova] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:51.061803 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d24bc5-aafb-45b9-a95f-23034cad58e2 service nova] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:51.062078 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d24bc5-aafb-45b9-a95f-23034cad58e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:51.071247 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d24bc5-aafb-45b9-a95f-23034cad58e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:51.072827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d24bc5-aafb-45b9-a95f-23034cad58e2 service nova] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:51.083338 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 515/1021] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:08:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:08:51.123807 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 507/1022] 10.222.0.39 () {58 vars in 1059 bytes} [Wed May 25 15:08:51 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:51.131429 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d24bc5-aafb-45b9-a95f-23034cad58e2 service nova] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:51.141157 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d24bc5-aafb-45b9-a95f-23034cad58e2 service nova] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:51.144953 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d977b-6fa6-42ff-bf38-8a5e98a1ebd4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b488bcd5ddc427fbdf78d56793a2035', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:51.145800 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d977b-6fa6-42ff-bf38-8a5e98a1ebd4 service glance] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:51.146055 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d977b-6fa6-42ff-bf38-8a5e98a1ebd4 service glance] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:51.146427 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d977b-6fa6-42ff-bf38-8a5e98a1ebd4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:51.156859 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d977b-6fa6-42ff-bf38-8a5e98a1ebd4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:51.158245 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d977b-6fa6-42ff-bf38-8a5e98a1ebd4 service glance] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:51.169406 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 516/1023] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:08:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:08:53.543976 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741aba8-c7f6-4e19-a243-91e06e3639f0 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:53.544623 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741aba8-c7f6-4e19-a243-91e06e3639f0 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:53.544623 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741aba8-c7f6-4e19-a243-91e06e3639f0 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:53.546915 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 508/1024] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:08:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:08:53.554073 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2325a-8d9e-4451-bac5-c6494d11b7dc None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:53.557440 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2325a-8d9e-4451-bac5-c6494d11b7dc None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:53.557440 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2325a-8d9e-4451-bac5-c6494d11b7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:53.585785 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-8ff2325a-8d9e-4451-bac5-c6494d11b7dc None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:08:53.587324 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-8ff2325a-8d9e-4451-bac5-c6494d11b7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:08:53.601276 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 517/1025] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:08:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:08:53.654321 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741aba8-c7f6-4e19-a243-91e06e3639f0 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:08:53.675619 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741aba8-c7f6-4e19-a243-91e06e3639f0 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:08:53.697090 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc91edc-8bbe-48c3-909e-6c6ef44f57e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:08:53.697790 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc91edc-8bbe-48c3-909e-6c6ef44f57e6 service nova] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:08:53.698081 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc91edc-8bbe-48c3-909e-6c6ef44f57e6 service nova] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:08:53.698406 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc91edc-8bbe-48c3-909e-6c6ef44f57e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:08:53.712676 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc91edc-8bbe-48c3-909e-6c6ef44f57e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:08:53.714809 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc91edc-8bbe-48c3-909e-6c6ef44f57e6 service nova] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:08:53.729958 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 509/1026] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:08:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:03.578762 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=37 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:03.723362 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=50 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:06.673493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6842f-c293-48df-84d2-5650b3096bab None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:06.674269 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6842f-c293-48df-84d2-5650b3096bab None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:06.674269 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6842f-c293-48df-84d2-5650b3096bab None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:06.675491 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 518/1027] 10.222.0.39 () {54 vars in 918 bytes} [Wed May 25 15:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:09:06.680831 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe248d-3bb6-4b74-abf4-40874e0f9b51 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:06.681352 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe248d-3bb6-4b74-abf4-40874e0f9b51 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:06.681352 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe248d-3bb6-4b74-abf4-40874e0f9b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:06.701727 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-5afe248d-3bb6-4b74-abf4-40874e0f9b51 None None] MFA Rules not processed for user `b28b47418d054fe091d379d83a30db11`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:06.703024 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-5afe248d-3bb6-4b74-abf4-40874e0f9b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:06.713450 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 510/1028] 10.222.0.39 () {58 vars in 1015 bytes} [Wed May 25 15:09:06 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:06.736512 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c201d6-d9cb-4974-b5f0-a89c304232bd None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:06.736779 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c201d6-d9cb-4974-b5f0-a89c304232bd None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:06.737060 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c201d6-d9cb-4974-b5f0-a89c304232bd None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:06.738493 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 519/1029] 10.222.0.39 () {54 vars in 918 bytes} [Wed May 25 15:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:09:06.744215 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b5d17-f816-4f41-9c18-5ca6b4f1dbcf None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:06.744467 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b5d17-f816-4f41-9c18-5ca6b4f1dbcf None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:06.744766 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b5d17-f816-4f41-9c18-5ca6b4f1dbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:06.765149 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-244b5d17-f816-4f41-9c18-5ca6b4f1dbcf None None] MFA Rules not processed for user `33f6a22c123f48a09af2f78636a04699`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:06.766392 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-244b5d17-f816-4f41-9c18-5ca6b4f1dbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:06.775815 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 511/1030] 10.222.0.39 () {58 vars in 1015 bytes} [Wed May 25 15:09:06 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:09.531871 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0432f-aa1c-4ad5-9f0d-4966b46f2e8e None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:09.532462 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0432f-aa1c-4ad5-9f0d-4966b46f2e8e None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:09.532462 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0432f-aa1c-4ad5-9f0d-4966b46f2e8e None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:09.533774 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 520/1031] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:09:09.539244 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a99ff-47cb-4317-87b2-fd1f0028e15b None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:09.539710 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a99ff-47cb-4317-87b2-fd1f0028e15b None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:09.539818 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a99ff-47cb-4317-87b2-fd1f0028e15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:09.558230 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-a80a99ff-47cb-4317-87b2-fd1f0028e15b None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:09.559458 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-a80a99ff-47cb-4317-87b2-fd1f0028e15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:09.568367 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 512/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:09:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:09.617607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0432f-aa1c-4ad5-9f0d-4966b46f2e8e None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:09.631816 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0432f-aa1c-4ad5-9f0d-4966b46f2e8e None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:09.637004 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db4fc4-0725-4073-8992-e1c92d7c53ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:09.637745 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db4fc4-0725-4073-8992-e1c92d7c53ed service nova] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:09.638058 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db4fc4-0725-4073-8992-e1c92d7c53ed service nova] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:09.638362 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db4fc4-0725-4073-8992-e1c92d7c53ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:09.646948 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db4fc4-0725-4073-8992-e1c92d7c53ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:09.648515 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db4fc4-0725-4073-8992-e1c92d7c53ed service nova] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:09.658077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 521/1033] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:09:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:10.677272 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779ef9c-2c29-4e94-8cf2-3740fc2f9b37 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:10.677874 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779ef9c-2c29-4e94-8cf2-3740fc2f9b37 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:10.677874 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779ef9c-2c29-4e94-8cf2-3740fc2f9b37 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:10.679283 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 513/1034] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:09:10.684449 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feec746-67ef-4d29-811d-1dbaab11da24 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:10.684931 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feec746-67ef-4d29-811d-1dbaab11da24 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:10.685035 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feec746-67ef-4d29-811d-1dbaab11da24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:10.704124 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-7feec746-67ef-4d29-811d-1dbaab11da24 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:10.705345 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-7feec746-67ef-4d29-811d-1dbaab11da24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:10.714176 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 522/1035] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:09:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:10.943489 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779ef9c-2c29-4e94-8cf2-3740fc2f9b37 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:10.959438 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779ef9c-2c29-4e94-8cf2-3740fc2f9b37 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:10.965204 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f9dc4-2020-4364-8665-7e30ae9169fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:10.965920 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f9dc4-2020-4364-8665-7e30ae9169fc service nova] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:10.966821 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f9dc4-2020-4364-8665-7e30ae9169fc service nova] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:10.967111 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f9dc4-2020-4364-8665-7e30ae9169fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:10.976021 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f9dc4-2020-4364-8665-7e30ae9169fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:10.977614 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f9dc4-2020-4364-8665-7e30ae9169fc service nova] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:10.988878 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 514/1036] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:09:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:11.951740 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156c293-a357-4f8c-9359-6963b8cfec62 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:11.952348 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156c293-a357-4f8c-9359-6963b8cfec62 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:11.952348 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156c293-a357-4f8c-9359-6963b8cfec62 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:11.953703 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 523/1037] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:09:11.959618 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f3a80-63d5-41c7-a849-4bd0bbcb5656 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:11.960184 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f3a80-63d5-41c7-a849-4bd0bbcb5656 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:11.960184 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f3a80-63d5-41c7-a849-4bd0bbcb5656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:11.980823 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-8b6f3a80-63d5-41c7-a849-4bd0bbcb5656 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:11.982205 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-8b6f3a80-63d5-41c7-a849-4bd0bbcb5656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:11.991552 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 515/1038] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:09:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:12.146831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156c293-a357-4f8c-9359-6963b8cfec62 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:12.162433 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156c293-a357-4f8c-9359-6963b8cfec62 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:12.167928 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91731a26-98c0-447a-a4bb-514ad442d1d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:12.168599 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91731a26-98c0-447a-a4bb-514ad442d1d1 service nova] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:12.168871 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91731a26-98c0-447a-a4bb-514ad442d1d1 service nova] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:12.169174 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91731a26-98c0-447a-a4bb-514ad442d1d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:12.178855 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91731a26-98c0-447a-a4bb-514ad442d1d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:12.180508 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91731a26-98c0-447a-a4bb-514ad442d1d1 service nova] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:12.192858 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 524/1039] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:09:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:13.113316 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb2772-2b92-4276-a699-a657de1cdb81 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:13.113894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb2772-2b92-4276-a699-a657de1cdb81 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:13.113894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb2772-2b92-4276-a699-a657de1cdb81 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:13.115486 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 516/1040] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:09:13.121324 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2532a64-2877-4ab9-8088-dca423a57d60 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:13.121941 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2532a64-2877-4ab9-8088-dca423a57d60 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:13.121941 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2532a64-2877-4ab9-8088-dca423a57d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:13.141633 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-a2532a64-2877-4ab9-8088-dca423a57d60 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:13.142881 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-a2532a64-2877-4ab9-8088-dca423a57d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:13.151390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 525/1041] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:09:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:13.306723 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb2772-2b92-4276-a699-a657de1cdb81 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:13.321568 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb2772-2b92-4276-a699-a657de1cdb81 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:13.327604 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7c668-ffa7-4d21-b5c6-bbdac1b91b21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:13.328265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7c668-ffa7-4d21-b5c6-bbdac1b91b21 service nova] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:13.328561 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7c668-ffa7-4d21-b5c6-bbdac1b91b21 service nova] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:13.328835 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7c668-ffa7-4d21-b5c6-bbdac1b91b21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:13.338188 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7c668-ffa7-4d21-b5c6-bbdac1b91b21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:13.339824 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7c668-ffa7-4d21-b5c6-bbdac1b91b21 service nova] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:13.349878 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 517/1042] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:09:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:14.262052 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41c7df-a8f6-411c-90cc-03b7c472f79f None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:14.262771 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41c7df-a8f6-411c-90cc-03b7c472f79f None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:14.262771 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41c7df-a8f6-411c-90cc-03b7c472f79f None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:14.264307 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 526/1043] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:09:14.269591 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cfc3f-01f4-415b-b238-13b2efbb8c07 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:14.270066 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cfc3f-01f4-415b-b238-13b2efbb8c07 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:14.270066 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cfc3f-01f4-415b-b238-13b2efbb8c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:14.289282 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-663cfc3f-01f4-415b-b238-13b2efbb8c07 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:14.290557 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-663cfc3f-01f4-415b-b238-13b2efbb8c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:14.300686 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 518/1044] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:09:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:14.454447 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41c7df-a8f6-411c-90cc-03b7c472f79f None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:14.470281 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41c7df-a8f6-411c-90cc-03b7c472f79f None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:14.475870 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb83d8-ad91-4da6-9ad8-21f820b0d649 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:14.476521 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb83d8-ad91-4da6-9ad8-21f820b0d649 service nova] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:14.476802 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb83d8-ad91-4da6-9ad8-21f820b0d649 service nova] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:14.477086 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb83d8-ad91-4da6-9ad8-21f820b0d649 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:14.486962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb83d8-ad91-4da6-9ad8-21f820b0d649 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:14.488558 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb83d8-ad91-4da6-9ad8-21f820b0d649 service nova] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:14.498948 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 527/1045] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:09:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:15.349068 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28edcdf-adb3-4984-ba46-f53cc7d2df87 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:15.350024 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28edcdf-adb3-4984-ba46-f53cc7d2df87 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:15.350343 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28edcdf-adb3-4984-ba46-f53cc7d2df87 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:15.351815 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 519/1046] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:09:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:09:15.357022 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb8e26-be34-4613-882e-5d68ac7c2a02 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:15.357677 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb8e26-be34-4613-882e-5d68ac7c2a02 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:15.357677 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb8e26-be34-4613-882e-5d68ac7c2a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:15.376961 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-e7cb8e26-be34-4613-882e-5d68ac7c2a02 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:15.378205 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-e7cb8e26-be34-4613-882e-5d68ac7c2a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:15.387044 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 528/1047] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:09:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:15.538170 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28edcdf-adb3-4984-ba46-f53cc7d2df87 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:15.553293 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28edcdf-adb3-4984-ba46-f53cc7d2df87 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:15.558660 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a059258-eb7a-4922-ab9b-ef2820b67374 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:15.559295 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a059258-eb7a-4922-ab9b-ef2820b67374 service nova] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:15.559563 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a059258-eb7a-4922-ab9b-ef2820b67374 service nova] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:15.559840 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a059258-eb7a-4922-ab9b-ef2820b67374 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:15.569621 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a059258-eb7a-4922-ab9b-ef2820b67374 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:15.571255 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a059258-eb7a-4922-ab9b-ef2820b67374 service nova] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:15.581291 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 520/1048] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:09:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:16.434317 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c5a50-fe6c-4dcd-bf3a-3ab5428d9e75 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:16.435173 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c5a50-fe6c-4dcd-bf3a-3ab5428d9e75 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:16.435173 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c5a50-fe6c-4dcd-bf3a-3ab5428d9e75 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:16.436517 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 529/1049] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:09:16.441572 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5feb2-c823-4aa5-81de-b27b7b395c16 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:16.442025 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5feb2-c823-4aa5-81de-b27b7b395c16 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:16.442130 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5feb2-c823-4aa5-81de-b27b7b395c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:16.464500 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-32c5feb2-c823-4aa5-81de-b27b7b395c16 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:16.465813 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-32c5feb2-c823-4aa5-81de-b27b7b395c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:16.475865 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 521/1050] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:09:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:16.628523 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c5a50-fe6c-4dcd-bf3a-3ab5428d9e75 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:16.643958 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c5a50-fe6c-4dcd-bf3a-3ab5428d9e75 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:16.650378 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3a165-b6c4-42e4-978f-21ad1d71aff6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:16.651013 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3a165-b6c4-42e4-978f-21ad1d71aff6 service nova] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:16.651294 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3a165-b6c4-42e4-978f-21ad1d71aff6 service nova] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:16.651568 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3a165-b6c4-42e4-978f-21ad1d71aff6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:16.660538 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3a165-b6c4-42e4-978f-21ad1d71aff6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:16.663469 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3a165-b6c4-42e4-978f-21ad1d71aff6 service nova] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:16.680705 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 530/1051] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:09:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:17.539669 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7f41d-b2a3-4f54-a31d-5e600edc117a None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:17.540260 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7f41d-b2a3-4f54-a31d-5e600edc117a None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:17.540260 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7f41d-b2a3-4f54-a31d-5e600edc117a None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:17.541682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 522/1052] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:09:17.547019 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79226a-5491-4cf9-ab64-9eb824c09ee0 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:17.547529 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79226a-5491-4cf9-ab64-9eb824c09ee0 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:17.547529 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79226a-5491-4cf9-ab64-9eb824c09ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:17.567110 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-7a79226a-5491-4cf9-ab64-9eb824c09ee0 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:17.568346 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-7a79226a-5491-4cf9-ab64-9eb824c09ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:17.577909 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 531/1053] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:09:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:17.730249 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7f41d-b2a3-4f54-a31d-5e600edc117a None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:17.745086 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7f41d-b2a3-4f54-a31d-5e600edc117a None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:17.750757 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96061627-c7f8-4ce4-99c6-be6a973d32a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:17.751385 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96061627-c7f8-4ce4-99c6-be6a973d32a6 service nova] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:17.751680 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96061627-c7f8-4ce4-99c6-be6a973d32a6 service nova] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:17.751953 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96061627-c7f8-4ce4-99c6-be6a973d32a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:17.760213 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96061627-c7f8-4ce4-99c6-be6a973d32a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:17.761788 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96061627-c7f8-4ce4-99c6-be6a973d32a6 service nova] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:17.771538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 523/1054] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:09:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:18.623013 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4583101-0460-4810-a556-38eb0bd2de4a None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:18.623610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4583101-0460-4810-a556-38eb0bd2de4a None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:18.623610 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4583101-0460-4810-a556-38eb0bd2de4a None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:18.624938 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 532/1055] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:09:18.630285 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e7dc8-5b18-4c90-aaaa-7302bae9f52f None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:18.630713 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e7dc8-5b18-4c90-aaaa-7302bae9f52f None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:18.630847 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e7dc8-5b18-4c90-aaaa-7302bae9f52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:18.650866 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-097e7dc8-5b18-4c90-aaaa-7302bae9f52f None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:18.652081 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-097e7dc8-5b18-4c90-aaaa-7302bae9f52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:18.661858 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 524/1056] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:09:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:18.812484 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4583101-0460-4810-a556-38eb0bd2de4a None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:18.828957 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4583101-0460-4810-a556-38eb0bd2de4a None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:18.834942 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b438924-7dc2-4fc0-8f48-b371e3ab5cf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:18.835593 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b438924-7dc2-4fc0-8f48-b371e3ab5cf0 service nova] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:18.835875 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b438924-7dc2-4fc0-8f48-b371e3ab5cf0 service nova] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:18.836149 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b438924-7dc2-4fc0-8f48-b371e3ab5cf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:18.845789 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b438924-7dc2-4fc0-8f48-b371e3ab5cf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:18.847409 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b438924-7dc2-4fc0-8f48-b371e3ab5cf0 service nova] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:18.857566 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 533/1057] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:09:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:21.007113 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdfb27-583f-4904-b136-1996e755ed3d None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:21.007710 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdfb27-583f-4904-b136-1996e755ed3d None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:21.007710 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdfb27-583f-4904-b136-1996e755ed3d None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:21.009071 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 525/1058] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:09:21.014635 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fb7ac-c446-4c21-9060-1b484df0754a None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:21.015082 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fb7ac-c446-4c21-9060-1b484df0754a None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:21.015228 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fb7ac-c446-4c21-9060-1b484df0754a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:21.034696 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-c78fb7ac-c446-4c21-9060-1b484df0754a None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:21.035923 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-c78fb7ac-c446-4c21-9060-1b484df0754a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:21.045309 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 534/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:09:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:21.086917 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdfb27-583f-4904-b136-1996e755ed3d None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:21.099651 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdfb27-583f-4904-b136-1996e755ed3d None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:21.103871 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e5fa3-4cf9-444e-bd4d-7d2014575dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:21.104558 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e5fa3-4cf9-444e-bd4d-7d2014575dda service neutron] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:21.104988 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e5fa3-4cf9-444e-bd4d-7d2014575dda service neutron] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:21.105282 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e5fa3-4cf9-444e-bd4d-7d2014575dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:21.115798 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e5fa3-4cf9-444e-bd4d-7d2014575dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:21.117249 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e5fa3-4cf9-444e-bd4d-7d2014575dda service neutron] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:21.127574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 526/1060] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:09:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:23.660013 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f112c11-6bcf-4f38-9ae0-39f3fc013102 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:23.660576 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f112c11-6bcf-4f38-9ae0-39f3fc013102 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:23.660576 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f112c11-6bcf-4f38-9ae0-39f3fc013102 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:23.661982 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 535/1061] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:09:23.667656 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39be19a-f634-4a9a-b284-04374904167f None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:23.668107 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39be19a-f634-4a9a-b284-04374904167f None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:23.668215 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39be19a-f634-4a9a-b284-04374904167f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:23.687820 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-e39be19a-f634-4a9a-b284-04374904167f None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:23.689051 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-e39be19a-f634-4a9a-b284-04374904167f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:23.697646 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 527/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:09:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:09:23.739721 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f112c11-6bcf-4f38-9ae0-39f3fc013102 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:23.751606 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f112c11-6bcf-4f38-9ae0-39f3fc013102 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:23.755399 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de354caa-dca8-4cda-a78f-6d4cb8eef7ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:23.756043 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de354caa-dca8-4cda-a78f-6d4cb8eef7ab service neutron] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:23.756319 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de354caa-dca8-4cda-a78f-6d4cb8eef7ab service neutron] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:23.756583 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de354caa-dca8-4cda-a78f-6d4cb8eef7ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:23.766501 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de354caa-dca8-4cda-a78f-6d4cb8eef7ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:23.767967 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de354caa-dca8-4cda-a78f-6d4cb8eef7ab service neutron] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:23.777969 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 536/1063] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:09:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:26.464742 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39f04e-5e27-4535-8585-1a0d44364931 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:26.465273 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39f04e-5e27-4535-8585-1a0d44364931 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:26.465273 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39f04e-5e27-4535-8585-1a0d44364931 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:26.466761 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 528/1064] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:09:26.472611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f977bb6-9466-4af6-bd8e-8e2a5e170bd9 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:26.473061 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f977bb6-9466-4af6-bd8e-8e2a5e170bd9 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:26.473150 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f977bb6-9466-4af6-bd8e-8e2a5e170bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:26.492734 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-9f977bb6-9466-4af6-bd8e-8e2a5e170bd9 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:26.493958 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-9f977bb6-9466-4af6-bd8e-8e2a5e170bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:26.502534 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 537/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:09:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:26.542919 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39f04e-5e27-4535-8585-1a0d44364931 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:26.555298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39f04e-5e27-4535-8585-1a0d44364931 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:26.559307 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd63c2-c177-45cf-86a7-86cf1bcefbfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:26.559992 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd63c2-c177-45cf-86a7-86cf1bcefbfc service neutron] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:26.560268 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd63c2-c177-45cf-86a7-86cf1bcefbfc service neutron] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:26.560538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd63c2-c177-45cf-86a7-86cf1bcefbfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:26.570266 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd63c2-c177-45cf-86a7-86cf1bcefbfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:26.571695 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd63c2-c177-45cf-86a7-86cf1bcefbfc service neutron] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:26.582209 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 529/1066] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:09:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:29.010483 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428b896-655b-4c48-959e-2f15bdb1bd25 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:29.011089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428b896-655b-4c48-959e-2f15bdb1bd25 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:29.011089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428b896-655b-4c48-959e-2f15bdb1bd25 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:29.012479 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 538/1067] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:09:29.018744 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b01b1-1c16-4855-8f67-7b43f3590d14 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:29.019216 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b01b1-1c16-4855-8f67-7b43f3590d14 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:29.019361 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b01b1-1c16-4855-8f67-7b43f3590d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:29.038817 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-cf1b01b1-1c16-4855-8f67-7b43f3590d14 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:29.040055 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-cf1b01b1-1c16-4855-8f67-7b43f3590d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:29.048966 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 530/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:09:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:29.089387 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428b896-655b-4c48-959e-2f15bdb1bd25 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:29.101612 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428b896-655b-4c48-959e-2f15bdb1bd25 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:29.105996 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4367e7-ff67-4663-96eb-db33c837be62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:29.106884 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4367e7-ff67-4663-96eb-db33c837be62 service neutron] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:29.107381 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4367e7-ff67-4663-96eb-db33c837be62 service neutron] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:29.107700 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4367e7-ff67-4663-96eb-db33c837be62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:29.121070 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4367e7-ff67-4663-96eb-db33c837be62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:29.122910 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4367e7-ff67-4663-96eb-db33c837be62 service neutron] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:29.133165 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 539/1069] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:09:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:31.468208 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c0256-1c37-42a8-b94d-c745e30f3c22 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:31.469005 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c0256-1c37-42a8-b94d-c745e30f3c22 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:31.469005 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c0256-1c37-42a8-b94d-c745e30f3c22 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:31.470180 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 531/1070] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:09:31.477077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b3c15-3ff4-44b6-b6b1-101a947c4999 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:31.477650 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b3c15-3ff4-44b6-b6b1-101a947c4999 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:31.477967 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b3c15-3ff4-44b6-b6b1-101a947c4999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:31.500473 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-227b3c15-3ff4-44b6-b6b1-101a947c4999 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:31.501732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-227b3c15-3ff4-44b6-b6b1-101a947c4999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:31.510266 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 540/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:09:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:31.551802 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c0256-1c37-42a8-b94d-c745e30f3c22 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:31.563552 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c0256-1c37-42a8-b94d-c745e30f3c22 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:31.567312 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c21a8fc-9430-4f68-a333-05c5a11c06fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:31.567968 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21a8fc-9430-4f68-a333-05c5a11c06fe service neutron] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:31.568258 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21a8fc-9430-4f68-a333-05c5a11c06fe service neutron] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:31.568534 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c21a8fc-9430-4f68-a333-05c5a11c06fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:31.580507 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c21a8fc-9430-4f68-a333-05c5a11c06fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:31.581939 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c21a8fc-9430-4f68-a333-05c5a11c06fe service neutron] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:31.592437 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 532/1072] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:09:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:33.942589 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58218b8d-1290-4c09-8c96-39182a01bb84 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:33.943107 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58218b8d-1290-4c09-8c96-39182a01bb84 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:33.943107 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58218b8d-1290-4c09-8c96-39182a01bb84 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:33.944428 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 541/1073] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:09:33.950289 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fea874-50e5-49b7-b85b-98660ac0a51a None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:33.950844 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fea874-50e5-49b7-b85b-98660ac0a51a None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:33.951175 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fea874-50e5-49b7-b85b-98660ac0a51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:33.958212 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=70 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:33.972857 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-69fea874-50e5-49b7-b85b-98660ac0a51a None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:33.974105 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-69fea874-50e5-49b7-b85b-98660ac0a51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:33.983433 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 533/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:09:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:34.024025 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58218b8d-1290-4c09-8c96-39182a01bb84 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:34.029965 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=64 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:34.037003 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58218b8d-1290-4c09-8c96-39182a01bb84 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:34.040638 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2022755-508d-4b60-9338-291f2805cd74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:34.041382 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2022755-508d-4b60-9338-291f2805cd74 service neutron] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:34.041667 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2022755-508d-4b60-9338-291f2805cd74 service neutron] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:34.041943 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2022755-508d-4b60-9338-291f2805cd74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:34.051870 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2022755-508d-4b60-9338-291f2805cd74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:34.053659 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2022755-508d-4b60-9338-291f2805cd74 service neutron] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:34.064313 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 542/1075] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:09:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:36.468136 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9dcc5-6c45-4f53-a293-3834910a0182 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:36.468666 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9dcc5-6c45-4f53-a293-3834910a0182 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:36.468666 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9dcc5-6c45-4f53-a293-3834910a0182 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:36.470131 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 534/1076] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:09:36.476958 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1954c2b-9549-42df-a9fd-0fe24bd0c581 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:36.477452 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1954c2b-9549-42df-a9fd-0fe24bd0c581 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:36.477762 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1954c2b-9549-42df-a9fd-0fe24bd0c581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:36.499734 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-f1954c2b-9549-42df-a9fd-0fe24bd0c581 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:36.500992 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-f1954c2b-9549-42df-a9fd-0fe24bd0c581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:36.510523 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 543/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:09:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:36.557906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9dcc5-6c45-4f53-a293-3834910a0182 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:36.570053 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9dcc5-6c45-4f53-a293-3834910a0182 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:36.574479 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539a9f6-c24a-49a6-a50f-f0bce0d41aa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:36.575121 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539a9f6-c24a-49a6-a50f-f0bce0d41aa8 service neutron] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:36.575410 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539a9f6-c24a-49a6-a50f-f0bce0d41aa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:36.575719 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539a9f6-c24a-49a6-a50f-f0bce0d41aa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:36.585739 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539a9f6-c24a-49a6-a50f-f0bce0d41aa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:36.587223 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539a9f6-c24a-49a6-a50f-f0bce0d41aa8 service neutron] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:36.597112 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 535/1078] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:09:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:09:38.979682 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478394e-6041-45e1-b902-48a1fc6c2eb5 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:38.980338 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478394e-6041-45e1-b902-48a1fc6c2eb5 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:38.980338 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478394e-6041-45e1-b902-48a1fc6c2eb5 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:38.981663 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 544/1079] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:09:38.988350 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f35f71-8744-4a20-8e3d-7c32cde55346 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:38.988892 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f35f71-8744-4a20-8e3d-7c32cde55346 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:38.988995 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f35f71-8744-4a20-8e3d-7c32cde55346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:39.008790 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-e9f35f71-8744-4a20-8e3d-7c32cde55346 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:39.010029 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-e9f35f71-8744-4a20-8e3d-7c32cde55346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:39.018910 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 536/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:09:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:39.068738 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478394e-6041-45e1-b902-48a1fc6c2eb5 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:39.081831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478394e-6041-45e1-b902-48a1fc6c2eb5 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:39.086069 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec335033-ab12-4210-8056-6cbfb4c4fd23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:39.086861 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec335033-ab12-4210-8056-6cbfb4c4fd23 service neutron] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:39.087247 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec335033-ab12-4210-8056-6cbfb4c4fd23 service neutron] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:39.087693 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec335033-ab12-4210-8056-6cbfb4c4fd23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:39.098781 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec335033-ab12-4210-8056-6cbfb4c4fd23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:39.100734 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec335033-ab12-4210-8056-6cbfb4c4fd23 service neutron] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:39.115673 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 545/1081] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:09:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:41.552011 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fe544-3c5e-416a-8c04-4e339457b181 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:41.552725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fe544-3c5e-416a-8c04-4e339457b181 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:41.552725 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fe544-3c5e-416a-8c04-4e339457b181 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:41.554135 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 537/1082] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:09:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:09:41.561966 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f465178-c98c-4193-b8de-75a687802a0c None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:41.562711 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f465178-c98c-4193-b8de-75a687802a0c None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:41.562711 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f465178-c98c-4193-b8de-75a687802a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:41.584311 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-5f465178-c98c-4193-b8de-75a687802a0c None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:41.585619 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-5f465178-c98c-4193-b8de-75a687802a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:41.595739 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 546/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:09:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:09:41.640265 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fe544-3c5e-416a-8c04-4e339457b181 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:41.654384 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fe544-3c5e-416a-8c04-4e339457b181 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:41.658853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d2470-dc24-4910-b83a-473a514cdb56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:41.659523 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d2470-dc24-4910-b83a-473a514cdb56 service neutron] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:41.659803 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d2470-dc24-4910-b83a-473a514cdb56 service neutron] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:41.660079 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d2470-dc24-4910-b83a-473a514cdb56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:41.671705 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d2470-dc24-4910-b83a-473a514cdb56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:41.673281 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d2470-dc24-4910-b83a-473a514cdb56 service neutron] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:41.685317 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 538/1084] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:09:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:44.267112 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc14eb3-1b81-443a-a86c-e5c09b313b7f None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:44.268018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc14eb3-1b81-443a-a86c-e5c09b313b7f None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:44.268018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc14eb3-1b81-443a-a86c-e5c09b313b7f None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:44.269962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 547/1085] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:09:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:09:44.278064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edacea7-8182-4cf8-8478-f2a0bea5f44a None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:44.278786 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edacea7-8182-4cf8-8478-f2a0bea5f44a None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:44.278786 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edacea7-8182-4cf8-8478-f2a0bea5f44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:44.300514 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-5edacea7-8182-4cf8-8478-f2a0bea5f44a None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:09:44.301848 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-5edacea7-8182-4cf8-8478-f2a0bea5f44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:09:44.313873 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 539/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:09:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:09:44.358116 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc14eb3-1b81-443a-a86c-e5c09b313b7f None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:09:44.375206 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc14eb3-1b81-443a-a86c-e5c09b313b7f None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:09:44.381057 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee93387-54fb-4ff0-b9cf-7f58c92cea43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:09:44.382160 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee93387-54fb-4ff0-b9cf-7f58c92cea43 service neutron] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:09:44.382591 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee93387-54fb-4ff0-b9cf-7f58c92cea43 service neutron] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:09:44.383051 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee93387-54fb-4ff0-b9cf-7f58c92cea43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:09:44.397485 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee93387-54fb-4ff0-b9cf-7f58c92cea43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:09:44.399141 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee93387-54fb-4ff0-b9cf-7f58c92cea43 service neutron] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:09:44.412070 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 548/1087] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:09:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:09:54.293147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=20 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:09:54.406470 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=23 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:20.582634 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a67af6-bbe5-468d-8b6b-f9ce9dd8e140 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:20.583243 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a67af6-bbe5-468d-8b6b-f9ce9dd8e140 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:20.583243 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a67af6-bbe5-468d-8b6b-f9ce9dd8e140 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:20.584468 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 540/1088] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:10:20.589965 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d027d90-d5a7-418f-90a3-17969af73656 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:20.590454 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d027d90-d5a7-418f-90a3-17969af73656 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:20.590549 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d027d90-d5a7-418f-90a3-17969af73656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:20.609958 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-3d027d90-d5a7-418f-90a3-17969af73656 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:10:20.611240 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-3d027d90-d5a7-418f-90a3-17969af73656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:20.619710 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 549/1089] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:10:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:10:20.669221 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c9a06-68b4-41cd-82e4-055adcf01624 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:20.669765 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c9a06-68b4-41cd-82e4-055adcf01624 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:20.670057 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c9a06-68b4-41cd-82e4-055adcf01624 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:20.671515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 541/1090] 10.222.0.39 () {54 vars in 962 bytes} [Wed May 25 15:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:10:20.676964 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fd1d8-6e48-4f4c-bdbf-975f867c026b None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:20.677257 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fd1d8-6e48-4f4c-bdbf-975f867c026b None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:20.677526 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fd1d8-6e48-4f4c-bdbf-975f867c026b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:20.697382 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-dd8fd1d8-6e48-4f4c-bdbf-975f867c026b None None] MFA Rules not processed for user `2b488bcd5ddc427fbdf78d56793a2035`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:10:20.698658 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-dd8fd1d8-6e48-4f4c-bdbf-975f867c026b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:20.711278 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 550/1091] 10.222.0.39 () {58 vars in 1059 bytes} [Wed May 25 15:10:20 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:10:20.719528 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c9a06-68b4-41cd-82e4-055adcf01624 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:20.731739 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c9a06-68b4-41cd-82e4-055adcf01624 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:20.735681 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98735dd1-37ef-4205-8418-b42f37e25d1e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b488bcd5ddc427fbdf78d56793a2035', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:20.736335 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98735dd1-37ef-4205-8418-b42f37e25d1e service glance] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:20.736616 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98735dd1-37ef-4205-8418-b42f37e25d1e service glance] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:20.736887 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98735dd1-37ef-4205-8418-b42f37e25d1e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:20.746246 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98735dd1-37ef-4205-8418-b42f37e25d1e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:20.747736 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98735dd1-37ef-4205-8418-b42f37e25d1e service glance] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:20.757515 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 542/1092] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:10:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:10:23.157967 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1ff0b-bb6d-406e-99a5-0fc4256df06e None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:23.158564 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1ff0b-bb6d-406e-99a5-0fc4256df06e None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:23.158564 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1ff0b-bb6d-406e-99a5-0fc4256df06e None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:23.159918 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 551/1093] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:10:23.165467 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c0dad-4f18-461f-bd13-c7c14442a253 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:23.165920 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c0dad-4f18-461f-bd13-c7c14442a253 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:23.166022 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c0dad-4f18-461f-bd13-c7c14442a253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:23.184267 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-a18c0dad-4f18-461f-bd13-c7c14442a253 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:10:23.185563 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-a18c0dad-4f18-461f-bd13-c7c14442a253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:23.194382 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 543/1094] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:10:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:10:23.219726 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1ff0b-bb6d-406e-99a5-0fc4256df06e None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:23.234350 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1ff0b-bb6d-406e-99a5-0fc4256df06e None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:23.239682 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c297294-0b51-42fd-b445-9d483fb23cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:23.240328 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c297294-0b51-42fd-b445-9d483fb23cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:23.240607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c297294-0b51-42fd-b445-9d483fb23cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:23.240881 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c297294-0b51-42fd-b445-9d483fb23cb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:23.241612 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c297294-0b51-42fd-b445-9d483fb23cb0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:23.243456 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: WARNING py.warnings [None req-6c297294-0b51-42fd-b445-9d483fb23cb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:10:23.243456 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: warnings.warn(msg) May 25 15:10:23.243456 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: May 25 15:10:23.244579 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c297294-0b51-42fd-b445-9d483fb23cb0 admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:23.263101 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 552/1095] 10.222.0.39 () {56 vars in 1108 bytes} [Wed May 25 15:10:23 2022] GET /identity/v3/projects => generated 1606 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:10:25.541746 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b088243-7f1a-4250-a438-7a64449af418 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:25.542375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b088243-7f1a-4250-a438-7a64449af418 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:25.542646 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b088243-7f1a-4250-a438-7a64449af418 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:25.544767 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 544/1096] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:10:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:10:25.552108 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4beb615-0ef8-4050-95cb-046c83040961 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:25.552631 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4beb615-0ef8-4050-95cb-046c83040961 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:25.552631 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4beb615-0ef8-4050-95cb-046c83040961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:25.573768 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-a4beb615-0ef8-4050-95cb-046c83040961 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:10:25.578193 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-a4beb615-0ef8-4050-95cb-046c83040961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:25.584820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 553/1097] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:10:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:10:25.632359 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b088243-7f1a-4250-a438-7a64449af418 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:25.646966 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b088243-7f1a-4250-a438-7a64449af418 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:25.652484 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf605c-394a-4f34-835e-2495e5d1dd04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:25.653164 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf605c-394a-4f34-835e-2495e5d1dd04 service nova] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:25.653446 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf605c-394a-4f34-835e-2495e5d1dd04 service nova] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:25.653710 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf605c-394a-4f34-835e-2495e5d1dd04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:25.663093 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf605c-394a-4f34-835e-2495e5d1dd04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:25.664680 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf605c-394a-4f34-835e-2495e5d1dd04 service nova] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:25.675450 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 545/1098] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:10:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:10:28.219695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4efda-3a79-4744-bd6b-1d8057835abd None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:28.220255 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4efda-3a79-4744-bd6b-1d8057835abd None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:28.220255 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4efda-3a79-4744-bd6b-1d8057835abd None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:28.221847 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 554/1099] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:10:28.227574 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef82f5-4de5-44d8-ab8c-0eeeb02e30d6 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:28.228100 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef82f5-4de5-44d8-ab8c-0eeeb02e30d6 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:28.228197 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef82f5-4de5-44d8-ab8c-0eeeb02e30d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:28.247587 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-02ef82f5-4de5-44d8-ab8c-0eeeb02e30d6 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:10:28.249048 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-02ef82f5-4de5-44d8-ab8c-0eeeb02e30d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:28.258389 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 546/1100] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:10:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:10:28.297995 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4efda-3a79-4744-bd6b-1d8057835abd None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:28.310868 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4efda-3a79-4744-bd6b-1d8057835abd None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:28.314913 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b0cb9-f0ac-4fe9-b0b2-741ee875e53d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:28.315573 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b0cb9-f0ac-4fe9-b0b2-741ee875e53d service neutron] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:28.315857 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b0cb9-f0ac-4fe9-b0b2-741ee875e53d service neutron] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:28.316120 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b0cb9-f0ac-4fe9-b0b2-741ee875e53d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:28.326443 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b0cb9-f0ac-4fe9-b0b2-741ee875e53d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:28.328117 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b0cb9-f0ac-4fe9-b0b2-741ee875e53d service neutron] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:28.338973 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 555/1101] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:10:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:10:30.715576 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2226c-b1ef-43bc-8030-1ee9951a3f97 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:30.716244 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2226c-b1ef-43bc-8030-1ee9951a3f97 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:30.716244 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2226c-b1ef-43bc-8030-1ee9951a3f97 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:30.718017 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 547/1102] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:10:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:10:30.723692 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22305276-6022-4d49-aacc-c9ed827a90ae None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:30.724294 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22305276-6022-4d49-aacc-c9ed827a90ae None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:30.724294 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22305276-6022-4d49-aacc-c9ed827a90ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:30.743130 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-22305276-6022-4d49-aacc-c9ed827a90ae None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:10:30.744364 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-22305276-6022-4d49-aacc-c9ed827a90ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:30.753067 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 556/1103] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:10:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:10:30.794036 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2226c-b1ef-43bc-8030-1ee9951a3f97 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:30.808151 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2226c-b1ef-43bc-8030-1ee9951a3f97 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:30.813665 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813784a-0b88-4eea-9833-97727f814e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:30.814594 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813784a-0b88-4eea-9833-97727f814e03 service neutron] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:30.814971 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813784a-0b88-4eea-9833-97727f814e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:30.815375 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813784a-0b88-4eea-9833-97727f814e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:30.828566 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813784a-0b88-4eea-9833-97727f814e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:30.830409 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813784a-0b88-4eea-9833-97727f814e03 service neutron] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:30.844674 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 548/1104] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:10:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:10:33.410489 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25ccbf-0cea-4f55-977e-9dc207f133a4 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:33.411233 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25ccbf-0cea-4f55-977e-9dc207f133a4 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:33.411233 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25ccbf-0cea-4f55-977e-9dc207f133a4 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:33.412573 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 557/1105] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:10:33.420432 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd61270-10ac-4a1b-9549-6d065a3d2815 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:33.421188 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd61270-10ac-4a1b-9549-6d065a3d2815 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:33.421188 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd61270-10ac-4a1b-9549-6d065a3d2815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:33.449966 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-acd61270-10ac-4a1b-9549-6d065a3d2815 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:10:33.451612 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-acd61270-10ac-4a1b-9549-6d065a3d2815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:33.464390 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 549/1106] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:10:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:10:33.516256 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25ccbf-0cea-4f55-977e-9dc207f133a4 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:33.533572 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25ccbf-0cea-4f55-977e-9dc207f133a4 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:33.539491 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3449d-06a4-404e-b3a9-df9865a3f16d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:33.540380 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3449d-06a4-404e-b3a9-df9865a3f16d service neutron] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:33.540773 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3449d-06a4-404e-b3a9-df9865a3f16d service neutron] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:33.541152 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3449d-06a4-404e-b3a9-df9865a3f16d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:33.554632 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3449d-06a4-404e-b3a9-df9865a3f16d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:33.556106 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3449d-06a4-404e-b3a9-df9865a3f16d service neutron] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:33.572797 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 558/1107] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:10:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:10:36.170770 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced8257-9a2a-4aac-a84f-accde3a020d4 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:36.171643 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced8257-9a2a-4aac-a84f-accde3a020d4 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:36.171643 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced8257-9a2a-4aac-a84f-accde3a020d4 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:36.172896 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 550/1108] 10.222.0.39 () {54 vars in 926 bytes} [Wed May 25 15:10:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:10:36.179966 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb1540-eed5-4d15-bf2c-ff56de1f0b59 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:36.180595 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb1540-eed5-4d15-bf2c-ff56de1f0b59 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:36.180595 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb1540-eed5-4d15-bf2c-ff56de1f0b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:36.204024 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-74cb1540-eed5-4d15-bf2c-ff56de1f0b59 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:10:36.205266 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-74cb1540-eed5-4d15-bf2c-ff56de1f0b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:10:36.213456 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 559/1109] 10.222.0.39 () {58 vars in 1023 bytes} [Wed May 25 15:10:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:10:36.273910 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced8257-9a2a-4aac-a84f-accde3a020d4 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:10:36.288004 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced8257-9a2a-4aac-a84f-accde3a020d4 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:10:36.292648 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908116a-1e3b-4626-864d-d437920d62ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:10:36.293526 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908116a-1e3b-4626-864d-d437920d62ad service neutron] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:10:36.294007 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908116a-1e3b-4626-864d-d437920d62ad service neutron] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:10:36.294330 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908116a-1e3b-4626-864d-d437920d62ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:10:36.306046 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908116a-1e3b-4626-864d-d437920d62ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:10:36.307780 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908116a-1e3b-4626-864d-d437920d62ad service neutron] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:10:36.320171 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 551/1110] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:10:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:10:46.198019 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=33 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:10:46.315053 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=33 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:20.553406 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0079a19-b3ab-463f-9c4a-256d8912f9be None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:20.554056 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0079a19-b3ab-463f-9c4a-256d8912f9be None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:20.554056 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0079a19-b3ab-463f-9c4a-256d8912f9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:20.644944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-b0079a19-b3ab-463f-9c4a-256d8912f9be None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:20.646109 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-b0079a19-b3ab-463f-9c4a-256d8912f9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:20.704988 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 560/1111] 10.222.0.39 () {58 vars in 957 bytes} [Wed May 25 15:12:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:20.715931 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11d4e9-a01d-4ae7-97d3-6471f8d9bfff None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:20.716690 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11d4e9-a01d-4ae7-97d3-6471f8d9bfff None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:20.716805 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11d4e9-a01d-4ae7-97d3-6471f8d9bfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:20.744654 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-7f11d4e9-a01d-4ae7-97d3-6471f8d9bfff None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:20.746506 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-7f11d4e9-a01d-4ae7-97d3-6471f8d9bfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:20.759617 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 552/1112] 10.222.0.39 () {58 vars in 957 bytes} [Wed May 25 15:12:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:12:20.765986 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0079a19-b3ab-463f-9c4a-256d8912f9be None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:20.777279 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0079a19-b3ab-463f-9c4a-256d8912f9be None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:20.784648 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5d003-2c4f-468a-b834-f73695dcd0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:20.785407 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5d003-2c4f-468a-b834-f73695dcd0fc admin admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:20.785822 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5d003-2c4f-468a-b834-f73695dcd0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:20.786281 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5d003-2c4f-468a-b834-f73695dcd0fc admin admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:20.787022 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5d003-2c4f-468a-b834-f73695dcd0fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:12:20.787378 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5d003-2c4f-468a-b834-f73695dcd0fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:20.788529 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: WARNING py.warnings [None req-3ca5d003-2c4f-468a-b834-f73695dcd0fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:12:20.788529 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: warnings.warn(msg) May 25 15:12:20.788529 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: May 25 15:12:20.789600 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5d003-2c4f-468a-b834-f73695dcd0fc admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:20.804511 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 561/1113] 10.222.0.39 () {58 vars in 1152 bytes} [Wed May 25 15:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:12:20.814447 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11d4e9-a01d-4ae7-97d3-6471f8d9bfff None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:20.832231 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11d4e9-a01d-4ae7-97d3-6471f8d9bfff None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:20.841013 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ac4cf-ce83-48af-a3e6-ea01fcbad699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:20.842547 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ac4cf-ce83-48af-a3e6-ea01fcbad699 admin admin] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:20.842831 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ac4cf-ce83-48af-a3e6-ea01fcbad699 admin admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:20.843347 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ac4cf-ce83-48af-a3e6-ea01fcbad699 admin admin] PATH_INFO: `/v3/projects` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:20.844708 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ac4cf-ce83-48af-a3e6-ea01fcbad699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:20.848234 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: WARNING py.warnings [None req-ca1ac4cf-ce83-48af-a3e6-ea01fcbad699 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:12:20.848234 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: warnings.warn(msg) May 25 15:12:20.848234 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: May 25 15:12:20.850743 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ac4cf-ce83-48af-a3e6-ea01fcbad699 admin admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:20.906908 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 553/1114] 10.222.0.39 () {60 vars in 1152 bytes} [Wed May 25 15:12:20 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:12:20.911588 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5d003-2c4f-468a-b834-f73695dcd0fc admin admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:20.923303 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5d003-2c4f-468a-b834-f73695dcd0fc admin admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:20.982841 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168d5ef-bf1f-44d3-bd15-f2c5c3c72779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:20.983533 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168d5ef-bf1f-44d3-bd15-f2c5c3c72779 admin admin] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:20.983812 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168d5ef-bf1f-44d3-bd15-f2c5c3c72779 admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:20.984088 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168d5ef-bf1f-44d3-bd15-f2c5c3c72779 admin admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:20.984800 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168d5ef-bf1f-44d3-bd15-f2c5c3c72779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:20.985827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: WARNING py.warnings [None req-a168d5ef-bf1f-44d3-bd15-f2c5c3c72779 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:12:20.985827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: warnings.warn(msg) May 25 15:12:20.985827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: May 25 15:12:20.987074 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168d5ef-bf1f-44d3-bd15-f2c5c3c72779 admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:21.010324 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 562/1115] 10.222.0.39 () {60 vars in 1143 bytes} [Wed May 25 15:12:20 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:12:21.015571 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ac4cf-ce83-48af-a3e6-ea01fcbad699 admin admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:21.026712 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ac4cf-ce83-48af-a3e6-ea01fcbad699 admin admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:21.031804 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac89589-cdbc-4d10-9c79-bab7c2f7cfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:21.032492 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac89589-cdbc-4d10-9c79-bab7c2f7cfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:21.032777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac89589-cdbc-4d10-9c79-bab7c2f7cfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:21.033051 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac89589-cdbc-4d10-9c79-bab7c2f7cfa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:21.033780 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac89589-cdbc-4d10-9c79-bab7c2f7cfa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:21.034924 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: WARNING py.warnings [None req-7ac89589-cdbc-4d10-9c79-bab7c2f7cfa9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:12:21.034924 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: warnings.warn(msg) May 25 15:12:21.034924 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: May 25 15:12:21.035814 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac89589-cdbc-4d10-9c79-bab7c2f7cfa9 admin admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:21.049957 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 554/1116] 10.222.0.39 () {58 vars in 1121 bytes} [Wed May 25 15:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:21.054182 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168d5ef-bf1f-44d3-bd15-f2c5c3c72779 admin admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:21.065215 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168d5ef-bf1f-44d3-bd15-f2c5c3c72779 admin admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:21.070736 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a77266-08fd-45fb-8eec-ebeb7fcf0d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:21.071418 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a77266-08fd-45fb-8eec-ebeb7fcf0d8c admin admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:21.071708 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a77266-08fd-45fb-8eec-ebeb7fcf0d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:21.071984 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a77266-08fd-45fb-8eec-ebeb7fcf0d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:21.072710 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a77266-08fd-45fb-8eec-ebeb7fcf0d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:21.073739 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: WARNING py.warnings [None req-13a77266-08fd-45fb-8eec-ebeb7fcf0d8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:12:21.073739 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: warnings.warn(msg) May 25 15:12:21.073739 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: May 25 15:12:21.074672 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a77266-08fd-45fb-8eec-ebeb7fcf0d8c admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:21.091747 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 563/1117] 10.222.0.39 () {58 vars in 1121 bytes} [Wed May 25 15:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:12:21.097068 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac89589-cdbc-4d10-9c79-bab7c2f7cfa9 admin admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:21.107632 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac89589-cdbc-4d10-9c79-bab7c2f7cfa9 admin admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:21.112660 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf452d-3bf9-462e-9c0b-3aa26ec8a0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:21.113566 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf452d-3bf9-462e-9c0b-3aa26ec8a0b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:21.113845 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf452d-3bf9-462e-9c0b-3aa26ec8a0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:21.114118 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf452d-3bf9-462e-9c0b-3aa26ec8a0b8 admin admin] PATH_INFO: `/v3/projects/e17ff18267c54b6ba5a69fd2572b6526/users/bf1c3774b8594fbd815911594301b7a7/roles/3ddf578e07094ecd820c44387851dbb8` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:21.130548 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf452d-3bf9-462e-9c0b-3aa26ec8a0b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e17ff18267c54b6ba5a69fd2572b6526, user_id=bf1c3774b8594fbd815911594301b7a7, role_id=3ddf578e07094ecd820c44387851dbb8)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:21.131596 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: WARNING py.warnings [None req-aebf452d-3bf9-462e-9c0b-3aa26ec8a0b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:12:21.131596 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: warnings.warn(msg) May 25 15:12:21.131596 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: May 25 15:12:21.133484 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf452d-3bf9-462e-9c0b-3aa26ec8a0b8 admin admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:21.160387 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 555/1118] 10.222.0.39 () {60 vars in 1482 bytes} [Wed May 25 15:12:21 2022] PUT /identity/v3/projects/e17ff18267c54b6ba5a69fd2572b6526/users/bf1c3774b8594fbd815911594301b7a7/roles/3ddf578e07094ecd820c44387851dbb8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:21.172645 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359aa7aa-99c8-4fda-bdb7-28c90386ee52 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:21.173077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359aa7aa-99c8-4fda-bdb7-28c90386ee52 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:21.173444 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359aa7aa-99c8-4fda-bdb7-28c90386ee52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:21.209395 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-359aa7aa-99c8-4fda-bdb7-28c90386ee52 None None] MFA Rules not processed for user `bf1c3774b8594fbd815911594301b7a7`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:21.210951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-359aa7aa-99c8-4fda-bdb7-28c90386ee52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:21.246472 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:21.288072 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 564/1119] 10.222.0.39 () {58 vars in 957 bytes} [Wed May 25 15:12:21 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:21.302618 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5cb79-6dfe-4a72-8d95-743eb08baab4 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:21.302902 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5cb79-6dfe-4a72-8d95-743eb08baab4 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:21.303190 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5cb79-6dfe-4a72-8d95-743eb08baab4 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:21.304596 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 556/1120] 10.222.0.39 () {54 vars in 963 bytes} [Wed May 25 15:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:12:21.310066 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb247058-5a74-453c-9cce-65dbc84d99b5 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:21.310356 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb247058-5a74-453c-9cce-65dbc84d99b5 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:21.310656 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb247058-5a74-453c-9cce-65dbc84d99b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:21.331750 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-bb247058-5a74-453c-9cce-65dbc84d99b5 None None] MFA Rules not processed for user `57fc08f3464a47faac6390af7bd8a680`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:21.333016 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-bb247058-5a74-453c-9cce-65dbc84d99b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:21.388448 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 565/1121] 10.222.0.39 () {58 vars in 1060 bytes} [Wed May 25 15:12:21 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:12:21.396559 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5cb79-6dfe-4a72-8d95-743eb08baab4 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:21.408499 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5cb79-6dfe-4a72-8d95-743eb08baab4 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:21.412250 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d16cf6-150f-4954-87ef-f2d78dc87b62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57fc08f3464a47faac6390af7bd8a680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:21.412843 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d16cf6-150f-4954-87ef-f2d78dc87b62 service cinder] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:21.413126 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d16cf6-150f-4954-87ef-f2d78dc87b62 service cinder] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:21.413404 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d16cf6-150f-4954-87ef-f2d78dc87b62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:21.423150 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d16cf6-150f-4954-87ef-f2d78dc87b62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:21.424620 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d16cf6-150f-4954-87ef-f2d78dc87b62 service cinder] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:21.435541 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 557/1122] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:12:21 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:12:21.488298 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08fed9-4914-42bd-a609-49b067ebb4da None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:21.488635 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08fed9-4914-42bd-a609-49b067ebb4da None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:21.488959 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08fed9-4914-42bd-a609-49b067ebb4da None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:21.490590 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 566/1123] 10.222.0.39 () {52 vars in 829 bytes} [Wed May 25 15:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:12:21.496350 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d16cf6-150f-4954-87ef-f2d78dc87b62 service cinder] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:21.586024 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d16cf6-150f-4954-87ef-f2d78dc87b62 service cinder] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:21.591541 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049da45-97cd-4256-a797-95fa203fbddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:21.592519 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049da45-97cd-4256-a797-95fa203fbddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:21.592813 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049da45-97cd-4256-a797-95fa203fbddf admin admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:21.593091 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049da45-97cd-4256-a797-95fa203fbddf admin admin] PATH_INFO: `/v3/users/bf1c3774b8594fbd815911594301b7a7` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:21.594523 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049da45-97cd-4256-a797-95fa203fbddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf1c3774b8594fbd815911594301b7a7)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:21.595575 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: WARNING py.warnings [None req-9049da45-97cd-4256-a797-95fa203fbddf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:12:21.595575 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: warnings.warn(msg) May 25 15:12:21.595575 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: May 25 15:12:21.596793 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049da45-97cd-4256-a797-95fa203fbddf admin admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:21.685615 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-9049da45-97cd-4256-a797-95fa203fbddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf1c3774b8594fbd815911594301b7a7'} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:21.702450 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-9049da45-97cd-4256-a797-95fa203fbddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf1c3774b8594fbd815911594301b7a7'} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:21.727897 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-9049da45-97cd-4256-a797-95fa203fbddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf1c3774b8594fbd815911594301b7a7'} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:21.728881 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-9049da45-97cd-4256-a797-95fa203fbddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf1c3774b8594fbd815911594301b7a7'} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:21.733393 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:21.741638 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-9049da45-97cd-4256-a797-95fa203fbddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf1c3774b8594fbd815911594301b7a7'} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:21.753102 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 558/1124] 10.222.0.39 () {58 vars in 1223 bytes} [Wed May 25 15:12:21 2022] DELETE /identity/v3/users/bf1c3774b8594fbd815911594301b7a7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:12:21.757951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c61b2-5664-4cd3-a6cf-70dd76705a58 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:21.758517 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c61b2-5664-4cd3-a6cf-70dd76705a58 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:21.758517 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c61b2-5664-4cd3-a6cf-70dd76705a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:21.777742 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-905c61b2-5664-4cd3-a6cf-70dd76705a58 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:12:21.779636 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-905c61b2-5664-4cd3-a6cf-70dd76705a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:21.847635 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 567/1125] 10.222.0.39 () {58 vars in 957 bytes} [Wed May 25 15:12:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:12:21.859004 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049da45-97cd-4256-a797-95fa203fbddf admin admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:21.860723 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-9049da45-97cd-4256-a797-95fa203fbddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:21.931936 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049da45-97cd-4256-a797-95fa203fbddf admin admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:21.936681 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5eea62-68b3-4fa1-9feb-e72c438c69a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:21.940210 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5eea62-68b3-4fa1-9feb-e72c438c69a4 service neutron] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:21.940556 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5eea62-68b3-4fa1-9feb-e72c438c69a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:21.941301 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5eea62-68b3-4fa1-9feb-e72c438c69a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:21.954899 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5eea62-68b3-4fa1-9feb-e72c438c69a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:21.956480 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5eea62-68b3-4fa1-9feb-e72c438c69a4 service neutron] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:21.968022 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 559/1126] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:12:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:12:22.436562 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c61b2-5664-4cd3-a6cf-70dd76705a58 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:12:22.438401 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-905c61b2-5664-4cd3-a6cf-70dd76705a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:12:22.462375 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c61b2-5664-4cd3-a6cf-70dd76705a58 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:12:22.476064 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4d0db-13c6-4eee-8fb3-792b76d25b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:12:22.477283 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4d0db-13c6-4eee-8fb3-792b76d25b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:12:22.477667 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4d0db-13c6-4eee-8fb3-792b76d25b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:12:22.478037 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4d0db-13c6-4eee-8fb3-792b76d25b43 admin admin] PATH_INFO: `/v3/projects/e17ff18267c54b6ba5a69fd2572b6526` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:12:22.479719 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4d0db-13c6-4eee-8fb3-792b76d25b43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e17ff18267c54b6ba5a69fd2572b6526)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:12:22.481090 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: WARNING py.warnings [None req-35c4d0db-13c6-4eee-8fb3-792b76d25b43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:12:22.481090 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: warnings.warn(msg) May 25 15:12:22.481090 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: May 25 15:12:22.482953 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4d0db-13c6-4eee-8fb3-792b76d25b43 admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:12:22.566184 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-35c4d0db-13c6-4eee-8fb3-792b76d25b43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e17ff18267c54b6ba5a69fd2572b6526', 'request_id': 'req-35c4d0db-13c6-4eee-8fb3-792b76d25b43'} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:22.579686 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-35c4d0db-13c6-4eee-8fb3-792b76d25b43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e17ff18267c54b6ba5a69fd2572b6526', 'request_id': 'req-35c4d0db-13c6-4eee-8fb3-792b76d25b43'} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:22.596373 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-35c4d0db-13c6-4eee-8fb3-792b76d25b43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e17ff18267c54b6ba5a69fd2572b6526', 'request_id': 'req-35c4d0db-13c6-4eee-8fb3-792b76d25b43'} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:22.611280 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-35c4d0db-13c6-4eee-8fb3-792b76d25b43 admin admin] The token cache is being invalidate because project e17ff18267c54b6ba5a69fd2572b6526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:12:22.611613 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-35c4d0db-13c6-4eee-8fb3-792b76d25b43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:22.612273 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-35c4d0db-13c6-4eee-8fb3-792b76d25b43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:12:22.614010 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 568/1127] 10.222.0.39 () {58 vars in 1232 bytes} [Wed May 25 15:12:22 2022] DELETE /identity/v3/projects/e17ff18267c54b6ba5a69fd2572b6526 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:12:31.962963 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:12:32.607543 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:46.614266 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929e3df-01a4-43a2-bf68-d72ed136fcd0 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:46.614969 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929e3df-01a4-43a2-bf68-d72ed136fcd0 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:46.614969 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929e3df-01a4-43a2-bf68-d72ed136fcd0 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:46.616238 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 560/1128] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:13:46.621636 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71cd8a-cd5b-4e96-87d4-99221c207026 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:46.622131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71cd8a-cd5b-4e96-87d4-99221c207026 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:46.622282 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71cd8a-cd5b-4e96-87d4-99221c207026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:46.643673 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-2d71cd8a-cd5b-4e96-87d4-99221c207026 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:46.645368 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-2d71cd8a-cd5b-4e96-87d4-99221c207026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:46.719537 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 569/1129] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:13:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:46.898847 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929e3df-01a4-43a2-bf68-d72ed136fcd0 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:46.901298 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-0929e3df-01a4-43a2-bf68-d72ed136fcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:47.005027 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929e3df-01a4-43a2-bf68-d72ed136fcd0 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:47.010201 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65e761-4fa6-4d3f-adfd-af18f2a07066 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:47.010884 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65e761-4fa6-4d3f-adfd-af18f2a07066 service nova] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:47.011173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65e761-4fa6-4d3f-adfd-af18f2a07066 service nova] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:47.011449 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65e761-4fa6-4d3f-adfd-af18f2a07066 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:47.019838 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65e761-4fa6-4d3f-adfd-af18f2a07066 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:47.021434 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65e761-4fa6-4d3f-adfd-af18f2a07066 service nova] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:47.030947 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 561/1130] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:13:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:47.903699 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec6676-7c31-4fe6-8733-c2be586ac1ae None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:47.904294 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec6676-7c31-4fe6-8733-c2be586ac1ae None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:47.904294 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec6676-7c31-4fe6-8733-c2be586ac1ae None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:47.905627 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 570/1131] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:13:47.910898 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b100d2-a981-4fee-8667-de263a5dc918 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:47.911401 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b100d2-a981-4fee-8667-de263a5dc918 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:47.911505 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b100d2-a981-4fee-8667-de263a5dc918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:47.931436 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-f4b100d2-a981-4fee-8667-de263a5dc918 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:47.932702 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-f4b100d2-a981-4fee-8667-de263a5dc918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:47.943436 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 562/1132] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:13:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:48.122483 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec6676-7c31-4fe6-8733-c2be586ac1ae None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:48.137998 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec6676-7c31-4fe6-8733-c2be586ac1ae None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:48.143991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54dba9-6a4f-43d3-b003-338ccb09bb45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:48.144671 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54dba9-6a4f-43d3-b003-338ccb09bb45 service nova] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:48.144959 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54dba9-6a4f-43d3-b003-338ccb09bb45 service nova] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:48.145241 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54dba9-6a4f-43d3-b003-338ccb09bb45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:48.155387 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb54dba9-6a4f-43d3-b003-338ccb09bb45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:48.156970 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb54dba9-6a4f-43d3-b003-338ccb09bb45 service nova] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:48.168207 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 571/1133] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:13:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:13:52.299453 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dac7fc-5be1-4893-980f-114a59960c55 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:52.300069 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dac7fc-5be1-4893-980f-114a59960c55 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:52.300069 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dac7fc-5be1-4893-980f-114a59960c55 None None] PATH_INFO: `/v3` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:52.301328 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 563/1134] 10.222.0.43 () {54 vars in 925 bytes} [Wed May 25 15:13:52 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:13:52.308677 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5756a2-948a-4ca2-812c-e762766bd0d7 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:52.309168 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5756a2-948a-4ca2-812c-e762766bd0d7 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:52.309290 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5756a2-948a-4ca2-812c-e762766bd0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:52.339576 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-1e5756a2-948a-4ca2-812c-e762766bd0d7 None None] MFA Rules not processed for user `b28b47418d054fe091d379d83a30db11`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:52.340796 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-1e5756a2-948a-4ca2-812c-e762766bd0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:52.408755 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 572/1135] 10.222.0.43 () {58 vars in 1015 bytes} [Wed May 25 15:13:52 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:57.925759 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=47 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:13:59.485007 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f5611-c052-49d7-ad49-1380e6146c39 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:59.485696 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f5611-c052-49d7-ad49-1380e6146c39 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:59.485696 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f5611-c052-49d7-ad49-1380e6146c39 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:59.486992 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 564/1136] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:13:59.491967 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52f204-0531-4fb4-b2d6-0cb3231d64b8 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:59.492433 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52f204-0531-4fb4-b2d6-0cb3231d64b8 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:59.492528 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52f204-0531-4fb4-b2d6-0cb3231d64b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:59.512803 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-6c52f204-0531-4fb4-b2d6-0cb3231d64b8 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:13:59.514047 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-6c52f204-0531-4fb4-b2d6-0cb3231d64b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:13:59.523570 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 573/1137] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:13:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:13:59.695020 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f5611-c052-49d7-ad49-1380e6146c39 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:13:59.709614 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f5611-c052-49d7-ad49-1380e6146c39 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:13:59.715825 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b695f9-5d28-4c09-a9f3-e37283a3e04d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:13:59.716494 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b695f9-5d28-4c09-a9f3-e37283a3e04d service nova] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:13:59.716758 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b695f9-5d28-4c09-a9f3-e37283a3e04d service nova] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:13:59.717064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b695f9-5d28-4c09-a9f3-e37283a3e04d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:13:59.726173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b695f9-5d28-4c09-a9f3-e37283a3e04d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:13:59.728000 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b695f9-5d28-4c09-a9f3-e37283a3e04d service nova] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:13:59.738212 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 565/1138] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:13:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:14:00.628003 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923dd41-2c7a-45b0-af33-7ed455ef7589 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:00.628597 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923dd41-2c7a-45b0-af33-7ed455ef7589 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:00.628597 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923dd41-2c7a-45b0-af33-7ed455ef7589 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:00.629946 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 574/1139] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:14:00.635827 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aae35c-e325-4ee0-8eb1-6e572e18b6ec None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:00.636355 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aae35c-e325-4ee0-8eb1-6e572e18b6ec None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:00.636355 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aae35c-e325-4ee0-8eb1-6e572e18b6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:00.656732 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-00aae35c-e325-4ee0-8eb1-6e572e18b6ec None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:00.657975 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-00aae35c-e325-4ee0-8eb1-6e572e18b6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:00.669549 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 566/1140] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:14:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:00.831452 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923dd41-2c7a-45b0-af33-7ed455ef7589 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:00.846516 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923dd41-2c7a-45b0-af33-7ed455ef7589 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:00.852831 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1d55b-4617-4735-b16c-e747053a13bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:00.853478 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1d55b-4617-4735-b16c-e747053a13bc service nova] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:00.853757 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1d55b-4617-4735-b16c-e747053a13bc service nova] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:00.854056 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1d55b-4617-4735-b16c-e747053a13bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:00.862734 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1d55b-4617-4735-b16c-e747053a13bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:00.864320 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1d55b-4617-4735-b16c-e747053a13bc service nova] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:00.874381 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 575/1141] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:14:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:14:01.615668 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73794f-559e-4fd7-8039-120e13a15c1c None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:01.616020 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73794f-559e-4fd7-8039-120e13a15c1c None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:01.616244 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73794f-559e-4fd7-8039-120e13a15c1c None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:01.617904 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 567/1142] 10.222.0.39 () {54 vars in 960 bytes} [Wed May 25 15:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:14:01.623216 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb57931-189c-42f3-9a21-d9e5df8e0ff8 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:01.623501 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb57931-189c-42f3-9a21-d9e5df8e0ff8 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:01.623801 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb57931-189c-42f3-9a21-d9e5df8e0ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:01.643890 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-edb57931-189c-42f3-9a21-d9e5df8e0ff8 None None] MFA Rules not processed for user `b28b47418d054fe091d379d83a30db11`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:01.645099 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-edb57931-189c-42f3-9a21-d9e5df8e0ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:01.654910 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 576/1143] 10.222.0.39 () {58 vars in 1057 bytes} [Wed May 25 15:14:01 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:01.662552 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73794f-559e-4fd7-8039-120e13a15c1c None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:01.677383 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73794f-559e-4fd7-8039-120e13a15c1c None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:01.682657 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76bf1a-2d03-48ae-821f-e9cc473c9f94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b28b47418d054fe091d379d83a30db11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:01.683305 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76bf1a-2d03-48ae-821f-e9cc473c9f94 service placement] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:01.683649 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76bf1a-2d03-48ae-821f-e9cc473c9f94 service placement] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:01.683878 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76bf1a-2d03-48ae-821f-e9cc473c9f94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:01.693368 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76bf1a-2d03-48ae-821f-e9cc473c9f94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:01.695052 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b76bf1a-2d03-48ae-821f-e9cc473c9f94 service placement] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:01.705811 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 568/1144] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:14:01 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:14:05.208306 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5daa0-8468-4ef9-b1ec-b53bebb19350 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:05.208993 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5daa0-8468-4ef9-b1ec-b53bebb19350 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:05.208993 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5daa0-8468-4ef9-b1ec-b53bebb19350 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:05.210318 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 577/1145] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:14:05.216276 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bff813-9d02-4456-a5ce-d413e9664cb8 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:05.216923 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bff813-9d02-4456-a5ce-d413e9664cb8 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:05.216923 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bff813-9d02-4456-a5ce-d413e9664cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:05.235989 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-08bff813-9d02-4456-a5ce-d413e9664cb8 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:05.237215 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-08bff813-9d02-4456-a5ce-d413e9664cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:05.247317 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 569/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:14:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:05.285903 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5daa0-8468-4ef9-b1ec-b53bebb19350 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:05.291797 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-ddf5daa0-8468-4ef9-b1ec-b53bebb19350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:05.358083 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:05.377787 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5daa0-8468-4ef9-b1ec-b53bebb19350 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:05.381638 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63562a4e-64fd-4fa8-9281-6c007898c8d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:05.382353 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63562a4e-64fd-4fa8-9281-6c007898c8d6 service neutron] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:05.382615 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63562a4e-64fd-4fa8-9281-6c007898c8d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:05.382896 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63562a4e-64fd-4fa8-9281-6c007898c8d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:05.394627 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63562a4e-64fd-4fa8-9281-6c007898c8d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:05.396085 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63562a4e-64fd-4fa8-9281-6c007898c8d6 service neutron] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:05.406760 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 578/1147] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:14:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:14:07.656510 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16206b60-a39e-440b-9cb8-df871dd16191 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:07.657108 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16206b60-a39e-440b-9cb8-df871dd16191 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:07.657108 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16206b60-a39e-440b-9cb8-df871dd16191 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:07.658504 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 570/1148] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:14:07.664428 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f7bb4-3165-4f52-8a01-33178a8c7dcb None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:07.664905 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f7bb4-3165-4f52-8a01-33178a8c7dcb None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:07.665007 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f7bb4-3165-4f52-8a01-33178a8c7dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:07.683800 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-eb2f7bb4-3165-4f52-8a01-33178a8c7dcb None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:07.685029 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-eb2f7bb4-3165-4f52-8a01-33178a8c7dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:07.693346 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 579/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:14:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:14:07.732173 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16206b60-a39e-440b-9cb8-df871dd16191 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:07.744546 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16206b60-a39e-440b-9cb8-df871dd16191 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:07.748033 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39ac3c-20ad-4ff4-b54a-627dc6308be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:07.748690 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39ac3c-20ad-4ff4-b54a-627dc6308be7 service neutron] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:07.748974 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39ac3c-20ad-4ff4-b54a-627dc6308be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:07.749249 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39ac3c-20ad-4ff4-b54a-627dc6308be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:07.759708 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39ac3c-20ad-4ff4-b54a-627dc6308be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:07.761163 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39ac3c-20ad-4ff4-b54a-627dc6308be7 service neutron] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:07.771524 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 571/1150] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:14:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:14:11.977828 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5596d-5aaa-405c-9671-42c84841ebf4 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:11.978438 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5596d-5aaa-405c-9671-42c84841ebf4 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:11.978438 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5596d-5aaa-405c-9671-42c84841ebf4 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:11.979750 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 580/1151] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:14:11.986182 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7597f0b-8e91-422e-9a39-61e72682c10b None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:11.987054 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7597f0b-8e91-422e-9a39-61e72682c10b None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:11.987054 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7597f0b-8e91-422e-9a39-61e72682c10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:12.006299 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-d7597f0b-8e91-422e-9a39-61e72682c10b None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:12.007821 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-d7597f0b-8e91-422e-9a39-61e72682c10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:12.017639 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 572/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:14:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:12.294959 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5596d-5aaa-405c-9671-42c84841ebf4 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:12.296935 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-08f5596d-5aaa-405c-9671-42c84841ebf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:12.374210 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5596d-5aaa-405c-9671-42c84841ebf4 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:12.377893 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd424b-8fa9-4b35-967a-5c8288b2dc4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57fc08f3464a47faac6390af7bd8a680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:12.378574 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd424b-8fa9-4b35-967a-5c8288b2dc4a service cinder] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:12.378855 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd424b-8fa9-4b35-967a-5c8288b2dc4a service cinder] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:12.379138 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd424b-8fa9-4b35-967a-5c8288b2dc4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:12.389641 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd424b-8fa9-4b35-967a-5c8288b2dc4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:12.391120 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd424b-8fa9-4b35-967a-5c8288b2dc4a service cinder] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:12.400915 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 581/1153] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:14:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:14:14.750067 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197cf70-8c35-4589-82eb-01033d8360bf None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:14.750705 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197cf70-8c35-4589-82eb-01033d8360bf None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:14.750705 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197cf70-8c35-4589-82eb-01033d8360bf None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:14.751989 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 573/1154] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:14:14.757580 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fdfde-9e0c-41a1-860f-bfc9158670ab None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:14.758044 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fdfde-9e0c-41a1-860f-bfc9158670ab None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:14.758160 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fdfde-9e0c-41a1-860f-bfc9158670ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:14.778823 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-ca6fdfde-9e0c-41a1-860f-bfc9158670ab None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:14:14.780174 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-ca6fdfde-9e0c-41a1-860f-bfc9158670ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:14.790748 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 582/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:14:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:14:15.064719 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197cf70-8c35-4589-82eb-01033d8360bf None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:14:15.066705 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-2197cf70-8c35-4589-82eb-01033d8360bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:14:15.081016 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197cf70-8c35-4589-82eb-01033d8360bf None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:14:15.084971 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f37038-97b0-4f0f-8131-ca9331ced881 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57fc08f3464a47faac6390af7bd8a680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:14:15.085616 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f37038-97b0-4f0f-8131-ca9331ced881 service cinder] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:14:15.086422 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f37038-97b0-4f0f-8131-ca9331ced881 service cinder] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:14:15.086422 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f37038-97b0-4f0f-8131-ca9331ced881 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:14:15.096753 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f37038-97b0-4f0f-8131-ca9331ced881 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:14:15.098320 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f37038-97b0-4f0f-8131-ca9331ced881 service cinder] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:14:15.108972 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 574/1156] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:14:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:14:24.772563 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=46 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:14:25.104639 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=33 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:15:34.729960 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436f0b1-b5d4-4271-a020-d9a81d3eeafd None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:34.730772 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436f0b1-b5d4-4271-a020-d9a81d3eeafd None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:34.730912 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436f0b1-b5d4-4271-a020-d9a81d3eeafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:34.752360 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-8436f0b1-b5d4-4271-a020-d9a81d3eeafd None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:15:34.753585 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-8436f0b1-b5d4-4271-a020-d9a81d3eeafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:34.762268 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 583/1157] 10.222.0.39 () {58 vars in 957 bytes} [Wed May 25 15:15:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:15:34.771769 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0a8a3-f77e-4052-b477-01b71dfe2e7c None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:34.772370 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0a8a3-f77e-4052-b477-01b71dfe2e7c None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:34.772370 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0a8a3-f77e-4052-b477-01b71dfe2e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:34.792068 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-5fe0a8a3-f77e-4052-b477-01b71dfe2e7c None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:15:34.792531 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22150048-e5bd-4f19-bd40-8e923f3ef419 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:34.792827 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22150048-e5bd-4f19-bd40-8e923f3ef419 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:34.793108 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22150048-e5bd-4f19-bd40-8e923f3ef419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:34.793205 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-5fe0a8a3-f77e-4052-b477-01b71dfe2e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:34.801440 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 575/1158] 10.222.0.39 () {58 vars in 957 bytes} [Wed May 25 15:15:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:15:34.806737 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0a8a3-f77e-4052-b477-01b71dfe2e7c None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:34.813262 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-22150048-e5bd-4f19-bd40-8e923f3ef419 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:15:34.814537 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-22150048-e5bd-4f19-bd40-8e923f3ef419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:34.816460 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0a8a3-f77e-4052-b477-01b71dfe2e7c None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:34.822696 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c233890-d011-44d3-858e-3456a6d95dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:34.823380 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c233890-d011-44d3-858e-3456a6d95dbe admin admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:34.823668 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c233890-d011-44d3-858e-3456a6d95dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:34.823949 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c233890-d011-44d3-858e-3456a6d95dbe admin admin] PATH_INFO: `/v3/domains` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:34.824714 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c233890-d011-44d3-858e-3456a6d95dbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87272) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:15:34.825022 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c233890-d011-44d3-858e-3456a6d95dbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:34.826047 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: WARNING py.warnings [None req-9c233890-d011-44d3-858e-3456a6d95dbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:15:34.826047 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: warnings.warn(msg) May 25 15:15:34.826047 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: May 25 15:15:34.826993 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c233890-d011-44d3-858e-3456a6d95dbe admin admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:34.833531 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 584/1159] 10.222.0.39 () {58 vars in 957 bytes} [Wed May 25 15:15:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:15:34.840935 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 576/1160] 10.222.0.39 () {58 vars in 1152 bytes} [Wed May 25 15:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:15:34.844273 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725b7d6-1925-44ef-a2ba-5b643ffd1c03 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:34.844564 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725b7d6-1925-44ef-a2ba-5b643ffd1c03 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:34.844993 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725b7d6-1925-44ef-a2ba-5b643ffd1c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:34.848661 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c233890-d011-44d3-858e-3456a6d95dbe admin admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:34.868653 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-3725b7d6-1925-44ef-a2ba-5b643ffd1c03 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:15:34.869879 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-3725b7d6-1925-44ef-a2ba-5b643ffd1c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:34.870301 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c233890-d011-44d3-858e-3456a6d95dbe admin admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:34.875320 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302957a1-20f8-4300-b1a4-1fe276f232b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:34.876030 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302957a1-20f8-4300-b1a4-1fe276f232b3 admin admin] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:34.876318 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302957a1-20f8-4300-b1a4-1fe276f232b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:34.876593 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302957a1-20f8-4300-b1a4-1fe276f232b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:34.877306 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302957a1-20f8-4300-b1a4-1fe276f232b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:34.878950 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 585/1161] 10.222.0.39 () {58 vars in 957 bytes} [Wed May 25 15:15:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:15:34.879284 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302957a1-20f8-4300-b1a4-1fe276f232b3 admin admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:34.884376 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725b7d6-1925-44ef-a2ba-5b643ffd1c03 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:34.894398 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725b7d6-1925-44ef-a2ba-5b643ffd1c03 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:34.900719 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad629642-04e5-4221-86ad-26dfcda6fc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:34.901339 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad629642-04e5-4221-86ad-26dfcda6fc7f admin admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:34.901615 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad629642-04e5-4221-86ad-26dfcda6fc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:34.901904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad629642-04e5-4221-86ad-26dfcda6fc7f admin admin] PATH_INFO: `/v3/domains` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:34.902663 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad629642-04e5-4221-86ad-26dfcda6fc7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87273) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:15:34.902968 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad629642-04e5-4221-86ad-26dfcda6fc7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:34.904609 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad629642-04e5-4221-86ad-26dfcda6fc7f admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:34.908208 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 577/1162] 10.222.0.39 () {60 vars in 1152 bytes} [Wed May 25 15:15:34 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:15:34.912429 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302957a1-20f8-4300-b1a4-1fe276f232b3 admin admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:34.917062 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 586/1163] 10.222.0.39 () {58 vars in 1152 bytes} [Wed May 25 15:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:15:34.925172 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad629642-04e5-4221-86ad-26dfcda6fc7f admin admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:34.936755 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad629642-04e5-4221-86ad-26dfcda6fc7f admin admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:34.984665 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302957a1-20f8-4300-b1a4-1fe276f232b3 admin admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:34.989530 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbcee3-854d-4cfd-a029-1843bd77e895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:34.990220 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbcee3-854d-4cfd-a029-1843bd77e895 admin admin] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:34.990537 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbcee3-854d-4cfd-a029-1843bd77e895 admin admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:34.990819 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbcee3-854d-4cfd-a029-1843bd77e895 admin admin] PATH_INFO: `/v3/users` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:34.991520 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbcee3-854d-4cfd-a029-1843bd77e895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:34.992663 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: WARNING py.warnings [None req-13dbcee3-854d-4cfd-a029-1843bd77e895 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:15:34.992663 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: warnings.warn(msg) May 25 15:15:34.992663 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: May 25 15:15:34.993960 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbcee3-854d-4cfd-a029-1843bd77e895 admin admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:35.000062 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b1ccd-8703-4638-b545-3aa81e8d1afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:35.000728 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b1ccd-8703-4638-b545-3aa81e8d1afa admin admin] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:35.001004 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b1ccd-8703-4638-b545-3aa81e8d1afa admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:35.001303 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b1ccd-8703-4638-b545-3aa81e8d1afa admin admin] PATH_INFO: `/v3/projects` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:35.001994 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b1ccd-8703-4638-b545-3aa81e8d1afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:35.003051 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: WARNING py.warnings [None req-d41b1ccd-8703-4638-b545-3aa81e8d1afa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:15:35.003051 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: warnings.warn(msg) May 25 15:15:35.003051 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: May 25 15:15:35.004262 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b1ccd-8703-4638-b545-3aa81e8d1afa admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:35.031841 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 578/1164] 10.222.0.39 () {60 vars in 1143 bytes} [Wed May 25 15:15:34 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:15:35.033084 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbcee3-854d-4cfd-a029-1843bd77e895 admin admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:35.035783 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 587/1165] 10.222.0.39 () {60 vars in 1152 bytes} [Wed May 25 15:15:34 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:15:35.041014 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b1ccd-8703-4638-b545-3aa81e8d1afa admin admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:35.043901 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbcee3-854d-4cfd-a029-1843bd77e895 admin admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:35.107971 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafb800-39e8-4d30-bb8c-94b4492647b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:35.108655 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafb800-39e8-4d30-bb8c-94b4492647b6 admin admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:35.108935 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafb800-39e8-4d30-bb8c-94b4492647b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:35.109208 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafb800-39e8-4d30-bb8c-94b4492647b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:35.109934 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafb800-39e8-4d30-bb8c-94b4492647b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:35.111585 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafb800-39e8-4d30-bb8c-94b4492647b6 admin admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:35.114303 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b1ccd-8703-4638-b545-3aa81e8d1afa admin admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:35.119594 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ee239-5bc7-4a98-ab09-fada598317b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:35.120271 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ee239-5bc7-4a98-ab09-fada598317b5 admin admin] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:35.120600 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ee239-5bc7-4a98-ab09-fada598317b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:35.120840 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ee239-5bc7-4a98-ab09-fada598317b5 admin admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:35.121541 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ee239-5bc7-4a98-ab09-fada598317b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:35.121934 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 579/1166] 10.222.0.39 () {58 vars in 1121 bytes} [Wed May 25 15:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:15:35.123649 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ee239-5bc7-4a98-ab09-fada598317b5 admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:35.126144 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafb800-39e8-4d30-bb8c-94b4492647b6 admin admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:35.141043 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafb800-39e8-4d30-bb8c-94b4492647b6 admin admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:35.146674 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d53094-3e2e-414c-9897-8a2c46539fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:35.147573 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d53094-3e2e-414c-9897-8a2c46539fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:35.147855 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d53094-3e2e-414c-9897-8a2c46539fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:35.148216 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d53094-3e2e-414c-9897-8a2c46539fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:35.148979 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d53094-3e2e-414c-9897-8a2c46539fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:35.149460 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 588/1167] 10.222.0.39 () {60 vars in 1143 bytes} [Wed May 25 15:15:35 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:15:35.150652 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d53094-3e2e-414c-9897-8a2c46539fc2 admin admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:35.153695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ee239-5bc7-4a98-ab09-fada598317b5 admin admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:35.163464 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 580/1168] 10.222.0.39 () {58 vars in 1121 bytes} [Wed May 25 15:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:15:35.164024 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ee239-5bc7-4a98-ab09-fada598317b5 admin admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:35.168214 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d53094-3e2e-414c-9897-8a2c46539fc2 admin admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:35.169085 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b89c95-846f-4aa4-8723-46ca634493d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:35.169764 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b89c95-846f-4aa4-8723-46ca634493d6 admin admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:35.170078 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b89c95-846f-4aa4-8723-46ca634493d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:35.170388 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b89c95-846f-4aa4-8723-46ca634493d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:35.171201 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b89c95-846f-4aa4-8723-46ca634493d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:35.172767 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b89c95-846f-4aa4-8723-46ca634493d6 admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:35.178400 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d53094-3e2e-414c-9897-8a2c46539fc2 admin admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:35.187502 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 589/1169] 10.222.0.39 () {58 vars in 1121 bytes} [Wed May 25 15:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:15:35.187677 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325fda8-79bb-496c-8a6c-8e9f42fd8f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:35.187677 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325fda8-79bb-496c-8a6c-8e9f42fd8f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:35.187677 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325fda8-79bb-496c-8a6c-8e9f42fd8f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:35.187677 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325fda8-79bb-496c-8a6c-8e9f42fd8f2f admin admin] PATH_INFO: `/v3/projects/32da54205b4041ffa1a082067adacd4c/users/e2b45e6af2d446c49aa7ca1b18cbd20a/roles/3ddf578e07094ecd820c44387851dbb8` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:35.188494 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b89c95-846f-4aa4-8723-46ca634493d6 admin admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:35.200611 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b89c95-846f-4aa4-8723-46ca634493d6 admin admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:35.203590 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325fda8-79bb-496c-8a6c-8e9f42fd8f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=32da54205b4041ffa1a082067adacd4c, user_id=e2b45e6af2d446c49aa7ca1b18cbd20a, role_id=3ddf578e07094ecd820c44387851dbb8)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:35.205408 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2b2f2-1bea-4a3a-804c-bc73752e6fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:35.206074 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2b2f2-1bea-4a3a-804c-bc73752e6fbe admin admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:35.206285 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8325fda8-79bb-496c-8a6c-8e9f42fd8f2f admin admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:35.206387 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2b2f2-1bea-4a3a-804c-bc73752e6fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:35.206655 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2b2f2-1bea-4a3a-804c-bc73752e6fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:35.207379 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2b2f2-1bea-4a3a-804c-bc73752e6fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:35.208960 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d2b2f2-1bea-4a3a-804c-bc73752e6fbe admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:35.220391 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 590/1170] 10.222.0.39 () {58 vars in 1121 bytes} [Wed May 25 15:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:15:35.221211 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 581/1171] 10.222.0.39 () {60 vars in 1482 bytes} [Wed May 25 15:15:35 2022] PUT /identity/v3/projects/32da54205b4041ffa1a082067adacd4c/users/e2b45e6af2d446c49aa7ca1b18cbd20a/roles/3ddf578e07094ecd820c44387851dbb8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:15:35.224871 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2b2f2-1bea-4a3a-804c-bc73752e6fbe admin admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:35.226007 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb90f7d-8832-4a37-b36f-3dce4d131d9f None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:35.226489 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb90f7d-8832-4a37-b36f-3dce4d131d9f None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:35.226743 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb90f7d-8832-4a37-b36f-3dce4d131d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:35.235454 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d2b2f2-1bea-4a3a-804c-bc73752e6fbe admin admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:35.245374 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-7bb90f7d-8832-4a37-b36f-3dce4d131d9f None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:15:35.246664 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-7bb90f7d-8832-4a37-b36f-3dce4d131d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:35.250980 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:15:35.254367 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:15:35.299881 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080a08d-aac7-45db-ae22-9bcced22336a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:35.300794 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080a08d-aac7-45db-ae22-9bcced22336a admin admin] REQUEST_METHOD: `PUT` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:35.301078 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080a08d-aac7-45db-ae22-9bcced22336a admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:35.301352 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080a08d-aac7-45db-ae22-9bcced22336a admin admin] PATH_INFO: `/v3/projects/92d6e07150b64b87997a6a649f715acf/users/144a2c92d3f8483da4f293e514baab42/roles/3ddf578e07094ecd820c44387851dbb8` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:35.309360 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 582/1172] 10.222.0.39 () {58 vars in 957 bytes} [Wed May 25 15:15:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:15:35.317314 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080a08d-aac7-45db-ae22-9bcced22336a admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d6e07150b64b87997a6a649f715acf, user_id=144a2c92d3f8483da4f293e514baab42, role_id=3ddf578e07094ecd820c44387851dbb8)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:35.318411 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: WARNING py.warnings [None req-0080a08d-aac7-45db-ae22-9bcced22336a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:15:35.318411 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: warnings.warn(msg) May 25 15:15:35.318411 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: May 25 15:15:35.319803 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb90f7d-8832-4a37-b36f-3dce4d131d9f None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:35.320994 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080a08d-aac7-45db-ae22-9bcced22336a admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:35.335856 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 591/1173] 10.222.0.39 () {60 vars in 1482 bytes} [Wed May 25 15:15:35 2022] PUT /identity/v3/projects/92d6e07150b64b87997a6a649f715acf/users/144a2c92d3f8483da4f293e514baab42/roles/3ddf578e07094ecd820c44387851dbb8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:15:35.341102 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2bec4-bce2-4a8c-82d3-a88a03856dd4 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:35.341391 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2bec4-bce2-4a8c-82d3-a88a03856dd4 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:35.341850 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2bec4-bce2-4a8c-82d3-a88a03856dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:35.360998 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-e2a2bec4-bce2-4a8c-82d3-a88a03856dd4 None None] MFA Rules not processed for user `6f740aaf3cae44509c45bafbff8e9374`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:15:35.362369 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-e2a2bec4-bce2-4a8c-82d3-a88a03856dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:35.378192 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb90f7d-8832-4a37-b36f-3dce4d131d9f None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:35.429025 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 592/1174] 10.222.0.39 () {58 vars in 957 bytes} [Wed May 25 15:15:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:15:35.429347 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951dc47e-4d89-49b0-a87c-5917914941be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:35.430078 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dc47e-4d89-49b0-a87c-5917914941be service neutron] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:35.430391 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dc47e-4d89-49b0-a87c-5917914941be service neutron] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:35.430670 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dc47e-4d89-49b0-a87c-5917914941be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:35.440308 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2bec4-bce2-4a8c-82d3-a88a03856dd4 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:35.442098 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951dc47e-4d89-49b0-a87c-5917914941be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:35.443578 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951dc47e-4d89-49b0-a87c-5917914941be service neutron] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:35.452999 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2bec4-bce2-4a8c-82d3-a88a03856dd4 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:35.454990 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 583/1175] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:15:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:15:35.456714 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1303d-3170-4ef8-84f2-979c280a479b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:35.457422 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1303d-3170-4ef8-84f2-979c280a479b service neutron] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:35.457708 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1303d-3170-4ef8-84f2-979c280a479b service neutron] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:35.457984 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1303d-3170-4ef8-84f2-979c280a479b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:35.469033 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1303d-3170-4ef8-84f2-979c280a479b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:35.470516 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1303d-3170-4ef8-84f2-979c280a479b service neutron] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:35.482710 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 593/1176] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:15:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:15:41.109545 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae5ff0-9b06-4720-8b52-d11694999af3 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:41.110170 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae5ff0-9b06-4720-8b52-d11694999af3 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:41.110170 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae5ff0-9b06-4720-8b52-d11694999af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:41.156172 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-f7ae5ff0-9b06-4720-8b52-d11694999af3 None None] MFA Rules not processed for user `e2b45e6af2d446c49aa7ca1b18cbd20a`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:15:41.157766 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-f7ae5ff0-9b06-4720-8b52-d11694999af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:41.228625 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:15:41.239288 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 584/1177] 10.222.0.39 () {58 vars in 957 bytes} [Wed May 25 15:15:41 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:15:41.240539 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1303d-3170-4ef8-84f2-979c280a479b service neutron] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:41.262912 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1303d-3170-4ef8-84f2-979c280a479b service neutron] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:41.268862 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6234527-bb71-4f64-b466-d2d432698487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:41.269937 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6234527-bb71-4f64-b466-d2d432698487 admin admin] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:41.271069 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6234527-bb71-4f64-b466-d2d432698487 admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:41.271606 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6234527-bb71-4f64-b466-d2d432698487 admin admin] PATH_INFO: `/v3/projects` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:41.272602 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6234527-bb71-4f64-b466-d2d432698487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:41.276811 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6234527-bb71-4f64-b466-d2d432698487 admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:41.340498 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 594/1178] 10.222.0.39 () {60 vars in 1152 bytes} [Wed May 25 15:15:41 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:15:41.350946 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae5ff0-9b06-4720-8b52-d11694999af3 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:41.371138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae5ff0-9b06-4720-8b52-d11694999af3 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:41.455608 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3edf1-a598-4913-85c0-ccf793b27465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:41.456531 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3edf1-a598-4913-85c0-ccf793b27465 admin admin] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:41.456968 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3edf1-a598-4913-85c0-ccf793b27465 admin admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:41.457415 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3edf1-a598-4913-85c0-ccf793b27465 admin admin] PATH_INFO: `/v3/users` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:41.458302 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3edf1-a598-4913-85c0-ccf793b27465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:41.460642 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3edf1-a598-4913-85c0-ccf793b27465 admin admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:41.493526 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 585/1179] 10.222.0.39 () {60 vars in 1143 bytes} [Wed May 25 15:15:41 2022] POST /identity/v3/users => generated 299 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:15:41.497532 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6234527-bb71-4f64-b466-d2d432698487 admin admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:41.508996 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6234527-bb71-4f64-b466-d2d432698487 admin admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:41.515081 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf9770-89de-4ea2-aefa-9ec388c8d86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:41.515743 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf9770-89de-4ea2-aefa-9ec388c8d86b admin admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:41.516174 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf9770-89de-4ea2-aefa-9ec388c8d86b admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:41.516457 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf9770-89de-4ea2-aefa-9ec388c8d86b admin admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:41.517205 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf9770-89de-4ea2-aefa-9ec388c8d86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:41.519056 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf9770-89de-4ea2-aefa-9ec388c8d86b admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:41.539054 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aba5f-798a-48e1-9807-277ab85acf09 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:41.539698 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aba5f-798a-48e1-9807-277ab85acf09 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:41.539698 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aba5f-798a-48e1-9807-277ab85acf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:41.540458 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 595/1180] 10.222.0.39 () {58 vars in 1121 bytes} [Wed May 25 15:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:15:41.542973 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf9770-89de-4ea2-aefa-9ec388c8d86b admin admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:41.558337 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf9770-89de-4ea2-aefa-9ec388c8d86b admin admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:41.564194 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35703a-0c78-42d4-bfdd-602995c0fb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:41.565370 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35703a-0c78-42d4-bfdd-602995c0fb04 admin admin] REQUEST_METHOD: `PUT` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:41.565963 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35703a-0c78-42d4-bfdd-602995c0fb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:41.566490 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35703a-0c78-42d4-bfdd-602995c0fb04 admin admin] PATH_INFO: `/v3/projects/100c458320824be79c9b018064538dae/users/06838bde181b412f9c1f5633a9f120b6/roles/ff521c95c8aa454ea3daa6bc36d055b1` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:41.574753 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-9c5aba5f-798a-48e1-9807-277ab85acf09 None None] MFA Rules not processed for user `144a2c92d3f8483da4f293e514baab42`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:15:41.576073 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-9c5aba5f-798a-48e1-9807-277ab85acf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:41.590555 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35703a-0c78-42d4-bfdd-602995c0fb04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=100c458320824be79c9b018064538dae, user_id=06838bde181b412f9c1f5633a9f120b6, role_id=ff521c95c8aa454ea3daa6bc36d055b1)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:41.593523 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35703a-0c78-42d4-bfdd-602995c0fb04 admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:41.621108 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 596/1181] 10.222.0.39 () {60 vars in 1482 bytes} [Wed May 25 15:15:41 2022] PUT /identity/v3/projects/100c458320824be79c9b018064538dae/users/06838bde181b412f9c1f5633a9f120b6/roles/ff521c95c8aa454ea3daa6bc36d055b1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:15:41.622436 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35703a-0c78-42d4-bfdd-602995c0fb04 admin admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:41.669339 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:15:41.672859 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 586/1182] 10.222.0.39 () {58 vars in 957 bytes} [Wed May 25 15:15:41 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:15:41.677787 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5aba5f-798a-48e1-9807-277ab85acf09 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:41.691331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5aba5f-798a-48e1-9807-277ab85acf09 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:41.708533 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35703a-0c78-42d4-bfdd-602995c0fb04 admin admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:41.715680 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252163bc-aecb-4f66-8d27-ca563046274a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:41.716708 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252163bc-aecb-4f66-8d27-ca563046274a admin admin] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:41.717093 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252163bc-aecb-4f66-8d27-ca563046274a admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:41.717530 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252163bc-aecb-4f66-8d27-ca563046274a admin admin] PATH_INFO: `/v3/roles` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:41.718353 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252163bc-aecb-4f66-8d27-ca563046274a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:41.720580 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252163bc-aecb-4f66-8d27-ca563046274a admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:41.732925 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 597/1183] 10.222.0.39 () {58 vars in 1121 bytes} [Wed May 25 15:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:15:41.737863 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252163bc-aecb-4f66-8d27-ca563046274a admin admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:41.752748 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252163bc-aecb-4f66-8d27-ca563046274a admin admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:41.761099 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0632e-15d7-4e09-8f5a-c865c24e3524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:41.762157 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0632e-15d7-4e09-8f5a-c865c24e3524 admin admin] REQUEST_METHOD: `PUT` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:41.762577 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0632e-15d7-4e09-8f5a-c865c24e3524 admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:41.762950 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0632e-15d7-4e09-8f5a-c865c24e3524 admin admin] PATH_INFO: `/v3/projects/100c458320824be79c9b018064538dae/users/06838bde181b412f9c1f5633a9f120b6/roles/ff521c95c8aa454ea3daa6bc36d055b1` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:41.765033 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f5bfc-a3c2-491c-8998-e633636aa722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:41.765429 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0632e-15d7-4e09-8f5a-c865c24e3524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=100c458320824be79c9b018064538dae, user_id=06838bde181b412f9c1f5633a9f120b6, role_id=ff521c95c8aa454ea3daa6bc36d055b1)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:41.765733 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f5bfc-a3c2-491c-8998-e633636aa722 admin admin] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:41.766024 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f5bfc-a3c2-491c-8998-e633636aa722 admin admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:41.766338 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f5bfc-a3c2-491c-8998-e633636aa722 admin admin] PATH_INFO: `/v3/projects` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:41.767051 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f5bfc-a3c2-491c-8998-e633636aa722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:41.768578 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0632e-15d7-4e09-8f5a-c865c24e3524 admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:41.769222 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f5bfc-a3c2-491c-8998-e633636aa722 admin admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:41.782188 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 598/1184] 10.222.0.39 () {60 vars in 1482 bytes} [Wed May 25 15:15:41 2022] PUT /identity/v3/projects/100c458320824be79c9b018064538dae/users/06838bde181b412f9c1f5633a9f120b6/roles/ff521c95c8aa454ea3daa6bc36d055b1 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:15:41.809567 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 587/1185] 10.222.0.39 () {60 vars in 1152 bytes} [Wed May 25 15:15:41 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:15:41.814447 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0632e-15d7-4e09-8f5a-c865c24e3524 admin admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:41.901646 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0632e-15d7-4e09-8f5a-c865c24e3524 admin admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:41.993829 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe85ef6-03d9-4b0f-80a4-4068db418af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:41.994863 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe85ef6-03d9-4b0f-80a4-4068db418af4 admin admin] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:41.995453 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe85ef6-03d9-4b0f-80a4-4068db418af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:41.995915 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe85ef6-03d9-4b0f-80a4-4068db418af4 admin admin] PATH_INFO: `/v3/users` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:41.997548 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe85ef6-03d9-4b0f-80a4-4068db418af4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:42.000249 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe85ef6-03d9-4b0f-80a4-4068db418af4 admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:42.031595 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 599/1186] 10.222.0.39 () {60 vars in 1143 bytes} [Wed May 25 15:15:41 2022] POST /identity/v3/users => generated 296 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:15:42.036400 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f5bfc-a3c2-491c-8998-e633636aa722 admin admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:42.043924 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:15:42.051621 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f5bfc-a3c2-491c-8998-e633636aa722 admin admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:42.060728 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c29dc4-314d-4662-81a5-59187bb03928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:42.062249 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c29dc4-314d-4662-81a5-59187bb03928 admin admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:42.062841 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c29dc4-314d-4662-81a5-59187bb03928 admin admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:42.063644 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c29dc4-314d-4662-81a5-59187bb03928 admin admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:42.064528 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c29dc4-314d-4662-81a5-59187bb03928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:42.069595 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c29dc4-314d-4662-81a5-59187bb03928 admin admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:42.088873 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 588/1187] 10.222.0.39 () {58 vars in 1121 bytes} [Wed May 25 15:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:15:42.093622 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe85ef6-03d9-4b0f-80a4-4068db418af4 admin admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:42.105460 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe85ef6-03d9-4b0f-80a4-4068db418af4 admin admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:42.111353 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09d0b7-5b89-45c2-8cea-4d707a62ad36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:42.112463 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09d0b7-5b89-45c2-8cea-4d707a62ad36 admin admin] REQUEST_METHOD: `PUT` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:42.114038 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09d0b7-5b89-45c2-8cea-4d707a62ad36 admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:42.114428 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09d0b7-5b89-45c2-8cea-4d707a62ad36 admin admin] PATH_INFO: `/v3/projects/23126d627bb645d0865d2b048cedfcb4/users/97fa9c03de104392a39645c143099ad8/roles/ff521c95c8aa454ea3daa6bc36d055b1` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:42.134658 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09d0b7-5b89-45c2-8cea-4d707a62ad36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23126d627bb645d0865d2b048cedfcb4, user_id=97fa9c03de104392a39645c143099ad8, role_id=ff521c95c8aa454ea3daa6bc36d055b1)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:42.137817 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09d0b7-5b89-45c2-8cea-4d707a62ad36 admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:42.163436 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 600/1188] 10.222.0.39 () {60 vars in 1482 bytes} [Wed May 25 15:15:42 2022] PUT /identity/v3/projects/23126d627bb645d0865d2b048cedfcb4/users/97fa9c03de104392a39645c143099ad8/roles/ff521c95c8aa454ea3daa6bc36d055b1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:15:42.164845 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c29dc4-314d-4662-81a5-59187bb03928 admin admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:42.177559 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c29dc4-314d-4662-81a5-59187bb03928 admin admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:42.316741 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0ae6e-f81f-4fdd-8917-f931f3ee9945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:42.317623 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0ae6e-f81f-4fdd-8917-f931f3ee9945 admin admin] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:42.317914 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0ae6e-f81f-4fdd-8917-f931f3ee9945 admin admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:42.318188 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0ae6e-f81f-4fdd-8917-f931f3ee9945 admin admin] PATH_INFO: `/v3/roles` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:42.319250 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0ae6e-f81f-4fdd-8917-f931f3ee9945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:42.320980 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0ae6e-f81f-4fdd-8917-f931f3ee9945 admin admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:42.332703 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 589/1189] 10.222.0.39 () {58 vars in 1121 bytes} [Wed May 25 15:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:15:42.337837 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09d0b7-5b89-45c2-8cea-4d707a62ad36 admin admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:42.349377 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09d0b7-5b89-45c2-8cea-4d707a62ad36 admin admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:42.355003 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3d9c6-d88b-4569-be29-64c80a89b84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:42.355936 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3d9c6-d88b-4569-be29-64c80a89b84c admin admin] REQUEST_METHOD: `PUT` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:42.356222 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3d9c6-d88b-4569-be29-64c80a89b84c admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:42.356499 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3d9c6-d88b-4569-be29-64c80a89b84c admin admin] PATH_INFO: `/v3/projects/23126d627bb645d0865d2b048cedfcb4/users/97fa9c03de104392a39645c143099ad8/roles/ff521c95c8aa454ea3daa6bc36d055b1` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:42.358867 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3d9c6-d88b-4569-be29-64c80a89b84c admin admin] RBAC: Authorizing `identity:create_grant(project_id=23126d627bb645d0865d2b048cedfcb4, user_id=97fa9c03de104392a39645c143099ad8, role_id=ff521c95c8aa454ea3daa6bc36d055b1)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:42.361607 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3d9c6-d88b-4569-be29-64c80a89b84c admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:42.376458 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 601/1190] 10.222.0.39 () {60 vars in 1482 bytes} [Wed May 25 15:15:42 2022] PUT /identity/v3/projects/23126d627bb645d0865d2b048cedfcb4/users/97fa9c03de104392a39645c143099ad8/roles/ff521c95c8aa454ea3daa6bc36d055b1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:15:49.326152 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb15db-9c6a-4550-934e-be7e739d2591 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:49.326705 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb15db-9c6a-4550-934e-be7e739d2591 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:49.326848 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb15db-9c6a-4550-934e-be7e739d2591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:49.383327 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-13bb15db-9c6a-4550-934e-be7e739d2591 None None] MFA Rules not processed for user `06838bde181b412f9c1f5633a9f120b6`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:15:49.385546 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-13bb15db-9c6a-4550-934e-be7e739d2591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:49.484278 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c893f1-5441-4503-8465-d0a61c609850 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:49.484884 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c893f1-5441-4503-8465-d0a61c609850 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:49.484884 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c893f1-5441-4503-8465-d0a61c609850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:49.504037 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 590/1191] 10.222.0.39 () {58 vars in 957 bytes} [Wed May 25 15:15:49 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:15:49.512947 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb15db-9c6a-4550-934e-be7e739d2591 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:49.514781 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-13bb15db-9c6a-4550-934e-be7e739d2591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:49.523297 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-d2c893f1-5441-4503-8465-d0a61c609850 None None] MFA Rules not processed for user `97fa9c03de104392a39645c143099ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:15:49.526112 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-d2c893f1-5441-4503-8465-d0a61c609850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:49.531799 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:15:49.604390 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb15db-9c6a-4550-934e-be7e739d2591 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:49.609319 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311bb50-d888-41ba-adb1-a07382d197bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b488bcd5ddc427fbdf78d56793a2035', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:49.610011 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311bb50-d888-41ba-adb1-a07382d197bb service glance] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:49.610330 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311bb50-d888-41ba-adb1-a07382d197bb service glance] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:49.610610 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311bb50-d888-41ba-adb1-a07382d197bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:49.619101 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 602/1192] 10.222.0.39 () {58 vars in 957 bytes} [Wed May 25 15:15:49 2022] POST /identity/v3/auth/tokens => generated 2873 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:15:49.631739 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=100 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:15:49.632697 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c893f1-5441-4503-8465-d0a61c609850 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:49.634375 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-d2c893f1-5441-4503-8465-d0a61c609850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:49.646570 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c893f1-5441-4503-8465-d0a61c609850 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:49.651181 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127db4f-4516-4a59-9d9c-c272a817b8f2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b488bcd5ddc427fbdf78d56793a2035', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:49.651853 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127db4f-4516-4a59-9d9c-c272a817b8f2 service glance] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:49.652134 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127db4f-4516-4a59-9d9c-c272a817b8f2 service glance] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:49.652410 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127db4f-4516-4a59-9d9c-c272a817b8f2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:49.696425 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311bb50-d888-41ba-adb1-a07382d197bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:49.699699 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311bb50-d888-41ba-adb1-a07382d197bb service glance] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:49.718421 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127db4f-4516-4a59-9d9c-c272a817b8f2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:49.718800 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 591/1193] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:15:49 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:15:49.720131 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127db4f-4516-4a59-9d9c-c272a817b8f2 service glance] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:49.731435 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 603/1194] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:15:49 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:15:58.350034 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af809a78-c882-4e96-9d10-3732da6d6529 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:58.350878 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af809a78-c882-4e96-9d10-3732da6d6529 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:58.350878 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af809a78-c882-4e96-9d10-3732da6d6529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:58.370493 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-af809a78-c882-4e96-9d10-3732da6d6529 None None] MFA Rules not processed for user `e2b45e6af2d446c49aa7ca1b18cbd20a`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:15:58.372123 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-af809a78-c882-4e96-9d10-3732da6d6529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:58.380335 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 592/1195] 10.222.0.39 () {58 vars in 957 bytes} [Wed May 25 15:15:58 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:15:58.674153 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c2b22-ed1c-4b10-a4d1-ee374cc74256 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:58.674873 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c2b22-ed1c-4b10-a4d1-ee374cc74256 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:58.674873 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c2b22-ed1c-4b10-a4d1-ee374cc74256 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:58.676355 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 604/1196] 10.222.0.39 () {54 vars in 961 bytes} [Wed May 25 15:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:15:58.684435 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006942a-5650-4030-beb2-915cc86a3fd0 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:58.684753 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006942a-5650-4030-beb2-915cc86a3fd0 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:58.685028 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006942a-5650-4030-beb2-915cc86a3fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:58.711074 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-7006942a-5650-4030-beb2-915cc86a3fd0 None None] MFA Rules not processed for user `33f6a22c123f48a09af2f78636a04699`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:15:58.712329 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-7006942a-5650-4030-beb2-915cc86a3fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:58.787444 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 593/1197] 10.222.0.39 () {58 vars in 1058 bytes} [Wed May 25 15:15:58 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:15:58.793682 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159b1b9-5fe8-48bf-8357-4cbaf9c34bd4 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:58.793990 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159b1b9-5fe8-48bf-8357-4cbaf9c34bd4 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:58.794346 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159b1b9-5fe8-48bf-8357-4cbaf9c34bd4 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:58.795771 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 605/1198] 10.222.0.39 () {54 vars in 912 bytes} [Wed May 25 15:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:15:58.803468 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85a3c6-082f-46e4-9f03-76826aa7b855 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:58.803871 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85a3c6-082f-46e4-9f03-76826aa7b855 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:58.804166 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85a3c6-082f-46e4-9f03-76826aa7b855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:58.827246 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-5a85a3c6-082f-46e4-9f03-76826aa7b855 None None] MFA Rules not processed for user `33f6a22c123f48a09af2f78636a04699`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:15:58.828487 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-5a85a3c6-082f-46e4-9f03-76826aa7b855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:58.839028 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 594/1199] 10.222.0.39 () {58 vars in 1009 bytes} [Wed May 25 15:15:58 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:15:58.851435 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159b1b9-5fe8-48bf-8357-4cbaf9c34bd4 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:58.862795 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159b1b9-5fe8-48bf-8357-4cbaf9c34bd4 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:58.866918 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07459972-03af-4b19-8633-fd7ace7a5089 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b488bcd5ddc427fbdf78d56793a2035', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:58.867884 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07459972-03af-4b19-8633-fd7ace7a5089 service glance] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:58.868168 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07459972-03af-4b19-8633-fd7ace7a5089 service glance] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:58.868826 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07459972-03af-4b19-8633-fd7ace7a5089 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:58.882634 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07459972-03af-4b19-8633-fd7ace7a5089 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:58.884396 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07459972-03af-4b19-8633-fd7ace7a5089 service glance] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:58.896082 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 606/1200] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:15:58 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:15:59.422749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b3a14-b668-4c17-85dd-23ee9bd2ffeb None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:59.423727 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b3a14-b668-4c17-85dd-23ee9bd2ffeb None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:59.424199 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b3a14-b668-4c17-85dd-23ee9bd2ffeb None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:59.425613 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 595/1201] 10.222.0.39 () {54 vars in 912 bytes} [Wed May 25 15:15:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:15:59.431815 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febef130-86a9-4782-a6e7-828d45a4ad44 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:59.432133 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febef130-86a9-4782-a6e7-828d45a4ad44 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:59.432390 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febef130-86a9-4782-a6e7-828d45a4ad44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:59.473301 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-febef130-86a9-4782-a6e7-828d45a4ad44 None None] MFA Rules not processed for user `f22ed37eb4a04bd4ad58739434623a48`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:15:59.474695 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-febef130-86a9-4782-a6e7-828d45a4ad44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:59.574314 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 607/1202] 10.222.0.39 () {58 vars in 1009 bytes} [Wed May 25 15:15:59 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:15:59.587638 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b3a14-b668-4c17-85dd-23ee9bd2ffeb None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:15:59.589586 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-e23b3a14-b668-4c17-85dd-23ee9bd2ffeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:15:59.609380 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b3a14-b668-4c17-85dd-23ee9bd2ffeb None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:15:59.614988 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5718a44-007b-4c47-bf9d-c4cf8af4c385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:15:59.615788 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5718a44-007b-4c47-bf9d-c4cf8af4c385 service neutron] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:15:59.616345 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5718a44-007b-4c47-bf9d-c4cf8af4c385 service neutron] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:15:59.617015 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5718a44-007b-4c47-bf9d-c4cf8af4c385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:15:59.625456 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5718a44-007b-4c47-bf9d-c4cf8af4c385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:15:59.627692 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5718a44-007b-4c47-bf9d-c4cf8af4c385 service neutron] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:15:59.637938 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 596/1203] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:15:59 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:16:00.155893 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad65c57-0295-40c3-8cc0-6f2bc9f03df9 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:00.156465 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad65c57-0295-40c3-8cc0-6f2bc9f03df9 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:00.156724 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad65c57-0295-40c3-8cc0-6f2bc9f03df9 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:00.159134 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 608/1204] 10.222.0.39 () {54 vars in 961 bytes} [Wed May 25 15:16:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:16:00.165937 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20c819-cd00-45cf-b055-0c137c0667ee None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:00.166476 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20c819-cd00-45cf-b055-0c137c0667ee None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:00.166993 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20c819-cd00-45cf-b055-0c137c0667ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:00.171099 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267d3bd-34ad-4dd8-8439-79710a681dc1 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:00.171834 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267d3bd-34ad-4dd8-8439-79710a681dc1 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:00.171958 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267d3bd-34ad-4dd8-8439-79710a681dc1 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:00.173452 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 609/1205] 10.222.0.39 () {54 vars in 960 bytes} [Wed May 25 15:16:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:16:00.181087 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9703f00-7ffd-4210-942c-62beb56e99e2 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:00.181596 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9703f00-7ffd-4210-942c-62beb56e99e2 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:00.181944 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9703f00-7ffd-4210-942c-62beb56e99e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:00.195150 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-0c20c819-cd00-45cf-b055-0c137c0667ee None None] MFA Rules not processed for user `33f6a22c123f48a09af2f78636a04699`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:16:00.196453 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-0c20c819-cd00-45cf-b055-0c137c0667ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:00.214996 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 597/1206] 10.222.0.39 () {58 vars in 1058 bytes} [Wed May 25 15:16:00 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:16:00.221373 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-e9703f00-7ffd-4210-942c-62beb56e99e2 None None] MFA Rules not processed for user `b28b47418d054fe091d379d83a30db11`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:16:00.221592 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd470d3f-c4ee-4377-a216-59c5916acca1 None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:00.221711 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd470d3f-c4ee-4377-a216-59c5916acca1 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:00.221968 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd470d3f-c4ee-4377-a216-59c5916acca1 None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:00.223230 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-e9703f00-7ffd-4210-942c-62beb56e99e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:00.224277 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 598/1207] 10.222.0.39 () {54 vars in 912 bytes} [Wed May 25 15:16:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:16:00.230063 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2a7ad-8365-4604-b354-9befa2a39a30 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:00.230538 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2a7ad-8365-4604-b354-9befa2a39a30 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:00.231300 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2a7ad-8365-4604-b354-9befa2a39a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:00.248962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=100 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:16:00.255486 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-30d2a7ad-8365-4604-b354-9befa2a39a30 None None] MFA Rules not processed for user `33f6a22c123f48a09af2f78636a04699`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:16:00.256118 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-30d2a7ad-8365-4604-b354-9befa2a39a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:00.273269 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 599/1208] 10.222.0.39 () {58 vars in 1009 bytes} [Wed May 25 15:16:00 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:16:00.283944 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2a7ad-8365-4604-b354-9befa2a39a30 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:16:00.297628 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2a7ad-8365-4604-b354-9befa2a39a30 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:16:00.303389 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9abe3d-8c74-4b08-aeb1-f7e127152235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:16:00.305068 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9abe3d-8c74-4b08-aeb1-f7e127152235 service neutron] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:00.305496 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9abe3d-8c74-4b08-aeb1-f7e127152235 service neutron] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:00.305875 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9abe3d-8c74-4b08-aeb1-f7e127152235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:00.320800 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 610/1209] 10.222.0.39 () {58 vars in 1057 bytes} [Wed May 25 15:16:00 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:16:00.330344 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9703f00-7ffd-4210-942c-62beb56e99e2 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:16:00.342218 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9abe3d-8c74-4b08-aeb1-f7e127152235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:16:00.343697 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9abe3d-8c74-4b08-aeb1-f7e127152235 service neutron] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:16:00.368245 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9703f00-7ffd-4210-942c-62beb56e99e2 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:16:00.376771 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 600/1210] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:16:00 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:16:00.378788 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468ebb7-d54f-4376-a458-2356fb749325 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b28b47418d054fe091d379d83a30db11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:16:00.379962 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468ebb7-d54f-4376-a458-2356fb749325 service placement] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:00.380420 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468ebb7-d54f-4376-a458-2356fb749325 service placement] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:00.380822 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468ebb7-d54f-4376-a458-2356fb749325 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:00.384989 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-a468ebb7-d54f-4376-a458-2356fb749325 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:00.415600 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468ebb7-d54f-4376-a458-2356fb749325 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:16:00.420017 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468ebb7-d54f-4376-a458-2356fb749325 service placement] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:16:00.448447 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 611/1211] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:16:00 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:16:10.359866 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=73 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:16:10.436103 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=24 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:16:10.808894 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319dae7-222e-4763-b545-cc197646aa8f None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:10.809211 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319dae7-222e-4763-b545-cc197646aa8f None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:10.809504 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319dae7-222e-4763-b545-cc197646aa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:10.830873 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-f319dae7-222e-4763-b545-cc197646aa8f None None] MFA Rules not processed for user `f22ed37eb4a04bd4ad58739434623a48`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:16:10.832136 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-f319dae7-222e-4763-b545-cc197646aa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:10.839141 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 601/1212] 10.222.0.43 () {58 vars in 1015 bytes} [Wed May 25 15:16:10 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:16:10.851934 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468ebb7-d54f-4376-a458-2356fb749325 service placement] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:16:10.861884 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468ebb7-d54f-4376-a458-2356fb749325 service placement] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:16:10.866089 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534e447-4358-441a-94b5-e134e7adf7fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:16:10.867025 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534e447-4358-441a-94b5-e134e7adf7fc service neutron] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:10.867222 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534e447-4358-441a-94b5-e134e7adf7fc service neutron] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:10.869368 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534e447-4358-441a-94b5-e134e7adf7fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:10.876121 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534e447-4358-441a-94b5-e134e7adf7fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:16:10.877645 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534e447-4358-441a-94b5-e134e7adf7fc service neutron] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:16:10.886309 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 612/1213] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:16:10 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:16:11.767064 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ef820-e93f-4185-9643-90d3285d263d None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:11.767684 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ef820-e93f-4185-9643-90d3285d263d None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:11.768090 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ef820-e93f-4185-9643-90d3285d263d None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:11.770682 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 602/1214] 10.222.0.39 () {54 vars in 921 bytes} [Wed May 25 15:16:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:16:11.824170 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155139c2-5d32-464d-bf7c-576101564ed0 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:11.824806 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155139c2-5d32-464d-bf7c-576101564ed0 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:11.824806 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155139c2-5d32-464d-bf7c-576101564ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:11.853085 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-155139c2-5d32-464d-bf7c-576101564ed0 None None] MFA Rules not processed for user `33f6a22c123f48a09af2f78636a04699`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:16:11.854855 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-155139c2-5d32-464d-bf7c-576101564ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:11.866104 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 613/1215] 10.222.0.39 () {58 vars in 1018 bytes} [Wed May 25 15:16:11 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:16:11.918415 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ef820-e93f-4185-9643-90d3285d263d None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:16:11.932593 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ef820-e93f-4185-9643-90d3285d263d None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:16:11.938480 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898cbdd-723f-4605-97f6-5b6c15ad8dff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:16:11.939148 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898cbdd-723f-4605-97f6-5b6c15ad8dff service nova] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:11.939431 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898cbdd-723f-4605-97f6-5b6c15ad8dff service nova] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:11.939708 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898cbdd-723f-4605-97f6-5b6c15ad8dff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:11.949219 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898cbdd-723f-4605-97f6-5b6c15ad8dff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:16:11.950867 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898cbdd-723f-4605-97f6-5b6c15ad8dff service nova] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:16:11.961665 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 603/1216] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:16:11 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:16:18.677744 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f49ff-d7e2-4afb-86e4-b0346a79fe37 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:18.678456 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f49ff-d7e2-4afb-86e4-b0346a79fe37 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:18.678744 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f49ff-d7e2-4afb-86e4-b0346a79fe37 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:18.680387 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 614/1217] 10.222.0.39 () {54 vars in 921 bytes} [Wed May 25 15:16:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:16:18.688286 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e68ee-f742-4298-846b-6a20bc912f4b None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:18.688844 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e68ee-f742-4298-846b-6a20bc912f4b None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:18.688844 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e68ee-f742-4298-846b-6a20bc912f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:18.709462 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-f27e68ee-f742-4298-846b-6a20bc912f4b None None] MFA Rules not processed for user `33f6a22c123f48a09af2f78636a04699`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:16:18.710741 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-f27e68ee-f742-4298-846b-6a20bc912f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:18.720303 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 604/1218] 10.222.0.39 () {58 vars in 1018 bytes} [Wed May 25 15:16:18 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:16:18.742092 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f49ff-d7e2-4afb-86e4-b0346a79fe37 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:16:18.764907 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f49ff-d7e2-4afb-86e4-b0346a79fe37 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:16:18.770468 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3115d-38fd-4032-a80a-1521e815028e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:16:18.771211 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3115d-38fd-4032-a80a-1521e815028e service nova] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:18.771575 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3115d-38fd-4032-a80a-1521e815028e service nova] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:18.771990 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3115d-38fd-4032-a80a-1521e815028e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:18.781148 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3115d-38fd-4032-a80a-1521e815028e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:16:18.782849 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3115d-38fd-4032-a80a-1521e815028e service nova] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:16:18.793164 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 615/1219] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:16:18 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:16:28.703789 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=12 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:16:28.789133 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=15 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:16:29.471095 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e68ee-f742-4298-846b-6a20bc912f4b None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:16:29.483032 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e68ee-f742-4298-846b-6a20bc912f4b None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:16:29.487311 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1413ca7-d418-410c-a855-0b7e2e633bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:16:29.487985 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1413ca7-d418-410c-a855-0b7e2e633bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:29.488267 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1413ca7-d418-410c-a855-0b7e2e633bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:29.488533 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1413ca7-d418-410c-a855-0b7e2e633bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:29.498885 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1413ca7-d418-410c-a855-0b7e2e633bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:16:29.500329 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1413ca7-d418-410c-a855-0b7e2e633bc4 service neutron] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:16:29.510709 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 605/1220] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:16:29 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:16:33.921700 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307acb96-da7c-45a6-a452-97f34c9cf4d4 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:33.922340 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307acb96-da7c-45a6-a452-97f34c9cf4d4 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:33.922340 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307acb96-da7c-45a6-a452-97f34c9cf4d4 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:33.923983 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 616/1221] 10.222.0.39 () {54 vars in 921 bytes} [Wed May 25 15:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:16:33.941716 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c6205-a3be-40b8-b4d3-70966fea7465 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:33.942352 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c6205-a3be-40b8-b4d3-70966fea7465 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:33.942352 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c6205-a3be-40b8-b4d3-70966fea7465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:33.965895 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-4b0c6205-a3be-40b8-b4d3-70966fea7465 None None] MFA Rules not processed for user `33f6a22c123f48a09af2f78636a04699`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:16:33.968141 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-4b0c6205-a3be-40b8-b4d3-70966fea7465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:33.982104 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 606/1222] 10.222.0.39 () {58 vars in 1018 bytes} [Wed May 25 15:16:33 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:16:34.006635 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307acb96-da7c-45a6-a452-97f34c9cf4d4 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:16:34.030315 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307acb96-da7c-45a6-a452-97f34c9cf4d4 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:16:34.036631 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c001cf-fc84-49ec-bb31-b57f7c5e5498 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:16:34.037759 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c001cf-fc84-49ec-bb31-b57f7c5e5498 service nova] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:34.038201 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c001cf-fc84-49ec-bb31-b57f7c5e5498 service nova] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:34.038935 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c001cf-fc84-49ec-bb31-b57f7c5e5498 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:34.058622 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c001cf-fc84-49ec-bb31-b57f7c5e5498 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:16:34.063318 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c001cf-fc84-49ec-bb31-b57f7c5e5498 service nova] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:16:34.075435 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 617/1223] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:16:34 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:16:43.957018 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=9 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:16:44.070386 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=6 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:16:51.826940 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706af50-e199-46be-b606-f353a6ad228c None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:16:51.827848 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706af50-e199-46be-b606-f353a6ad228c None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:16:51.827848 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706af50-e199-46be-b606-f353a6ad228c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:16:51.851379 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-4706af50-e199-46be-b606-f353a6ad228c None None] MFA Rules not processed for user `144a2c92d3f8483da4f293e514baab42`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:16:51.852621 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-4706af50-e199-46be-b606-f353a6ad228c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:16:51.861297 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 607/1224] 10.222.0.39 () {58 vars in 957 bytes} [Wed May 25 15:16:51 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:17:01.845806 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=3 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:17:18.519159 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b950a-f94a-43cb-a69b-3a8f9ab11e23 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:17:18.519743 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b950a-f94a-43cb-a69b-3a8f9ab11e23 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:17:18.519743 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b950a-f94a-43cb-a69b-3a8f9ab11e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:17:18.540911 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-985b950a-f94a-43cb-a69b-3a8f9ab11e23 None None] MFA Rules not processed for user `144a2c92d3f8483da4f293e514baab42`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:17:18.542177 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-985b950a-f94a-43cb-a69b-3a8f9ab11e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:17:18.550275 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 618/1225] 10.222.0.39 () {58 vars in 957 bytes} [Wed May 25 15:17:18 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:17:28.535688 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=3 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:17:34.609350 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c38d0c-367a-4660-91c3-20772f1916dc None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:17:34.609882 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c38d0c-367a-4660-91c3-20772f1916dc None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:17:34.609995 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c38d0c-367a-4660-91c3-20772f1916dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:17:34.630085 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-27c38d0c-367a-4660-91c3-20772f1916dc None None] MFA Rules not processed for user `144a2c92d3f8483da4f293e514baab42`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:17:34.631357 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-27c38d0c-367a-4660-91c3-20772f1916dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:17:34.639382 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 608/1226] 10.222.0.39 () {58 vars in 957 bytes} [Wed May 25 15:17:34 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:17:34.931968 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf074be-1d34-4219-a10e-b0d33bb9f961 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:17:34.932717 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf074be-1d34-4219-a10e-b0d33bb9f961 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:17:34.932863 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf074be-1d34-4219-a10e-b0d33bb9f961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:17:34.987774 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-3bf074be-1d34-4219-a10e-b0d33bb9f961 None None] MFA Rules not processed for user `f22ed37eb4a04bd4ad58739434623a48`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:17:34.989062 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-3bf074be-1d34-4219-a10e-b0d33bb9f961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:17:35.005163 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 619/1227] 10.222.0.39 () {58 vars in 1009 bytes} [Wed May 25 15:17:34 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:17:35.016777 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c38d0c-367a-4660-91c3-20772f1916dc None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:17:35.027961 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c38d0c-367a-4660-91c3-20772f1916dc None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:17:35.032269 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011ce49-28d8-4082-a53b-609bd08784a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:17:35.032974 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011ce49-28d8-4082-a53b-609bd08784a8 service neutron] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:17:35.033256 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011ce49-28d8-4082-a53b-609bd08784a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:17:35.033654 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011ce49-28d8-4082-a53b-609bd08784a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:17:35.041965 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011ce49-28d8-4082-a53b-609bd08784a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:17:35.043456 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011ce49-28d8-4082-a53b-609bd08784a8 service neutron] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:17:35.052680 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 609/1228] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:17:35 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:17:45.002288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=17 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:17:45.048139 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=9 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:18:01.036830 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec551a95-1838-44f2-991e-51867b1976e4 None None] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:01.037389 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec551a95-1838-44f2-991e-51867b1976e4 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:01.037389 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec551a95-1838-44f2-991e-51867b1976e4 None None] PATH_INFO: `/` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:01.039072 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 620/1229] 10.222.0.39 () {54 vars in 921 bytes} [Wed May 25 15:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:18:01.049759 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceff4a8-2b8d-45e5-bf82-b7ca23c87700 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:01.050388 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceff4a8-2b8d-45e5-bf82-b7ca23c87700 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:01.050388 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceff4a8-2b8d-45e5-bf82-b7ca23c87700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:01.073010 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-4ceff4a8-2b8d-45e5-bf82-b7ca23c87700 None None] MFA Rules not processed for user `b28b47418d054fe091d379d83a30db11`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:18:01.074452 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-4ceff4a8-2b8d-45e5-bf82-b7ca23c87700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:18:01.085706 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 610/1230] 10.222.0.39 () {58 vars in 1018 bytes} [Wed May 25 15:18:01 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:18:01.106193 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec551a95-1838-44f2-991e-51867b1976e4 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:18:01.125723 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec551a95-1838-44f2-991e-51867b1976e4 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:18:01.132644 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cabd7-6974-4aac-bc3f-74ab1601ceb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b28b47418d054fe091d379d83a30db11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:18:01.134037 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cabd7-6974-4aac-bc3f-74ab1601ceb3 service placement] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:01.134651 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cabd7-6974-4aac-bc3f-74ab1601ceb3 service placement] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:01.134935 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cabd7-6974-4aac-bc3f-74ab1601ceb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:01.145820 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987cabd7-6974-4aac-bc3f-74ab1601ceb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:18:01.147482 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987cabd7-6974-4aac-bc3f-74ab1601ceb3 service placement] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:18:01.159927 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 621/1231] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:18:01 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:18:04.678048 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e38ca-6696-4ed3-8beb-82dc37f597bf None None] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:04.678943 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e38ca-6696-4ed3-8beb-82dc37f597bf None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:04.679623 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e38ca-6696-4ed3-8beb-82dc37f597bf None None] PATH_INFO: `/` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:04.681477 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 611/1232] 10.222.0.39 () {54 vars in 921 bytes} [Wed May 25 15:18:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:18:04.694417 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271791b-7156-4666-b383-b3cf05033cec None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:04.694967 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271791b-7156-4666-b383-b3cf05033cec None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:04.695188 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271791b-7156-4666-b383-b3cf05033cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:04.718054 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-5271791b-7156-4666-b383-b3cf05033cec None None] MFA Rules not processed for user `b28b47418d054fe091d379d83a30db11`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:18:04.719772 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-5271791b-7156-4666-b383-b3cf05033cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:18:04.733005 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 622/1233] 10.222.0.39 () {58 vars in 1018 bytes} [Wed May 25 15:18:04 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:18:04.753970 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e38ca-6696-4ed3-8beb-82dc37f597bf None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:18:04.757231 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271791b-7156-4666-b383-b3cf05033cec None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:18:04.772250 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271791b-7156-4666-b383-b3cf05033cec None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:18:04.779977 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f66e74-6f07-4f7c-88d3-c727a67382b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b28b47418d054fe091d379d83a30db11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:18:04.780660 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f66e74-6f07-4f7c-88d3-c727a67382b9 service placement] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:04.780947 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f66e74-6f07-4f7c-88d3-c727a67382b9 service placement] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:04.781251 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f66e74-6f07-4f7c-88d3-c727a67382b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:04.792539 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f66e74-6f07-4f7c-88d3-c727a67382b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:18:04.794575 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f66e74-6f07-4f7c-88d3-c727a67382b9 service placement] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:18:04.805845 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 623/1234] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:18:04 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:18:04.849557 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e38ca-6696-4ed3-8beb-82dc37f597bf None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:18:04.855296 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9748a8-7711-49ab-8d56-21210339ab54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:18:04.856477 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9748a8-7711-49ab-8d56-21210339ab54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:04.856763 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9748a8-7711-49ab-8d56-21210339ab54 admin admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:04.857042 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9748a8-7711-49ab-8d56-21210339ab54 admin admin] PATH_INFO: `/v3/users/e2b45e6af2d446c49aa7ca1b18cbd20a` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:04.858378 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9748a8-7711-49ab-8d56-21210339ab54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2b45e6af2d446c49aa7ca1b18cbd20a)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:18:04.860749 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9748a8-7711-49ab-8d56-21210339ab54 admin admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:18:04.919751 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-5c9748a8-7711-49ab-8d56-21210339ab54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2b45e6af2d446c49aa7ca1b18cbd20a'} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:04.927479 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-5c9748a8-7711-49ab-8d56-21210339ab54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2b45e6af2d446c49aa7ca1b18cbd20a'} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:04.940355 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-5c9748a8-7711-49ab-8d56-21210339ab54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2b45e6af2d446c49aa7ca1b18cbd20a'} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:04.941108 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-5c9748a8-7711-49ab-8d56-21210339ab54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2b45e6af2d446c49aa7ca1b18cbd20a'} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:04.949659 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-5c9748a8-7711-49ab-8d56-21210339ab54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2b45e6af2d446c49aa7ca1b18cbd20a'} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:04.955918 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 612/1235] 10.222.0.39 () {58 vars in 1223 bytes} [Wed May 25 15:18:04 2022] DELETE /identity/v3/users/e2b45e6af2d446c49aa7ca1b18cbd20a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:18:05.152703 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f66e74-6f07-4f7c-88d3-c727a67382b9 service placement] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:18:05.164503 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f66e74-6f07-4f7c-88d3-c727a67382b9 service placement] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:18:05.238029 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9b58e-2996-40c3-845d-0662c6002f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:18:05.239038 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9b58e-2996-40c3-845d-0662c6002f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:05.239319 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9b58e-2996-40c3-845d-0662c6002f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:05.239595 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9b58e-2996-40c3-845d-0662c6002f06 admin admin] PATH_INFO: `/v3/projects/32da54205b4041ffa1a082067adacd4c` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:05.241002 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9b58e-2996-40c3-845d-0662c6002f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32da54205b4041ffa1a082067adacd4c)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:18:05.242985 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9b58e-2996-40c3-845d-0662c6002f06 admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:18:05.310074 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-71b9b58e-2996-40c3-845d-0662c6002f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32da54205b4041ffa1a082067adacd4c', 'request_id': 'req-71b9b58e-2996-40c3-845d-0662c6002f06'} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:05.320178 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-71b9b58e-2996-40c3-845d-0662c6002f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32da54205b4041ffa1a082067adacd4c', 'request_id': 'req-71b9b58e-2996-40c3-845d-0662c6002f06'} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:05.327141 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-71b9b58e-2996-40c3-845d-0662c6002f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32da54205b4041ffa1a082067adacd4c', 'request_id': 'req-71b9b58e-2996-40c3-845d-0662c6002f06'} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:05.337756 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-71b9b58e-2996-40c3-845d-0662c6002f06 admin admin] The token cache is being invalidate because project 32da54205b4041ffa1a082067adacd4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:18:05.338043 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-71b9b58e-2996-40c3-845d-0662c6002f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:05.338800 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-71b9b58e-2996-40c3-845d-0662c6002f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:05.340375 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 624/1236] 10.222.0.39 () {58 vars in 1232 bytes} [Wed May 25 15:18:05 2022] DELETE /identity/v3/projects/32da54205b4041ffa1a082067adacd4c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:18:05.344464 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9748a8-7711-49ab-8d56-21210339ab54 admin admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:18:05.345926 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-5c9748a8-7711-49ab-8d56-21210339ab54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:18:05.359099 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9748a8-7711-49ab-8d56-21210339ab54 admin admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:18:05.420138 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988583f-ad27-471a-97d9-005b8f6d4855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:18:05.421448 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988583f-ad27-471a-97d9-005b8f6d4855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:05.421803 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988583f-ad27-471a-97d9-005b8f6d4855 admin admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:05.422163 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988583f-ad27-471a-97d9-005b8f6d4855 admin admin] PATH_INFO: `/v3/users/06838bde181b412f9c1f5633a9f120b6` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:05.423989 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988583f-ad27-471a-97d9-005b8f6d4855 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06838bde181b412f9c1f5633a9f120b6)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:18:05.425974 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988583f-ad27-471a-97d9-005b8f6d4855 admin admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:18:05.431219 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:18:05.487005 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-9988583f-ad27-471a-97d9-005b8f6d4855 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06838bde181b412f9c1f5633a9f120b6'} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:05.494067 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-9988583f-ad27-471a-97d9-005b8f6d4855 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06838bde181b412f9c1f5633a9f120b6'} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:05.506901 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-9988583f-ad27-471a-97d9-005b8f6d4855 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06838bde181b412f9c1f5633a9f120b6'} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:05.507696 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-9988583f-ad27-471a-97d9-005b8f6d4855 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06838bde181b412f9c1f5633a9f120b6'} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:05.517053 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-9988583f-ad27-471a-97d9-005b8f6d4855 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06838bde181b412f9c1f5633a9f120b6'} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:05.525424 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 613/1237] 10.222.0.39 () {58 vars in 1223 bytes} [Wed May 25 15:18:05 2022] DELETE /identity/v3/users/06838bde181b412f9c1f5633a9f120b6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:18:05.718995 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9b58e-2996-40c3-845d-0662c6002f06 admin admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:18:05.720783 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-71b9b58e-2996-40c3-845d-0662c6002f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:18:05.734562 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9b58e-2996-40c3-845d-0662c6002f06 admin admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:18:05.790951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:18:05.797509 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b6c2a-1c26-4e1b-a715-16f88c6df2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:18:05.798499 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b6c2a-1c26-4e1b-a715-16f88c6df2f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:05.799172 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b6c2a-1c26-4e1b-a715-16f88c6df2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:05.799273 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b6c2a-1c26-4e1b-a715-16f88c6df2f9 admin admin] PATH_INFO: `/v3/projects/100c458320824be79c9b018064538dae` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:05.800574 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b6c2a-1c26-4e1b-a715-16f88c6df2f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=100c458320824be79c9b018064538dae)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:18:05.802963 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b6c2a-1c26-4e1b-a715-16f88c6df2f9 admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:18:05.857147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-887b6c2a-1c26-4e1b-a715-16f88c6df2f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '100c458320824be79c9b018064538dae', 'request_id': 'req-887b6c2a-1c26-4e1b-a715-16f88c6df2f9'} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:05.866569 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-887b6c2a-1c26-4e1b-a715-16f88c6df2f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '100c458320824be79c9b018064538dae', 'request_id': 'req-887b6c2a-1c26-4e1b-a715-16f88c6df2f9'} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:05.873183 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-887b6c2a-1c26-4e1b-a715-16f88c6df2f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '100c458320824be79c9b018064538dae', 'request_id': 'req-887b6c2a-1c26-4e1b-a715-16f88c6df2f9'} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:05.884398 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-887b6c2a-1c26-4e1b-a715-16f88c6df2f9 admin admin] The token cache is being invalidate because project 100c458320824be79c9b018064538dae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87273) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:18:05.884681 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-887b6c2a-1c26-4e1b-a715-16f88c6df2f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:05.885322 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-887b6c2a-1c26-4e1b-a715-16f88c6df2f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:18:05.886929 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 625/1238] 10.222.0.39 () {58 vars in 1232 bytes} [Wed May 25 15:18:05 2022] DELETE /identity/v3/projects/100c458320824be79c9b018064538dae => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:18:15.521189 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=24,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:18:15.881466 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:18:36.589159 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c98844-3125-4241-8942-acfe0adc0fa1 None None] REQUEST_METHOD: `POST` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:36.589750 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c98844-3125-4241-8942-acfe0adc0fa1 None None] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:36.589750 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c98844-3125-4241-8942-acfe0adc0fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:36.609026 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.auth.core [None req-77c98844-3125-4241-8942-acfe0adc0fa1 None None] MFA Rules not processed for user `144a2c92d3f8483da4f293e514baab42`. Rule list: `[]` (Enabled: `True`). {{(pid=87272) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:18:36.610270 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-77c98844-3125-4241-8942-acfe0adc0fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:18:36.681651 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 614/1239] 10.222.0.39 () {58 vars in 957 bytes} [Wed May 25 15:18:36 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:18:46.672585 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=25 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:18:49.684018 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b6c2a-1c26-4e1b-a715-16f88c6df2f9 admin admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:18:49.685533 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-887b6c2a-1c26-4e1b-a715-16f88c6df2f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:18:49.750178 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b6c2a-1c26-4e1b-a715-16f88c6df2f9 admin admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:18:49.754498 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77356174-dc9d-4650-9773-b940fa9d41e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:18:49.755156 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77356174-dc9d-4650-9773-b940fa9d41e3 service neutron] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:18:49.755441 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77356174-dc9d-4650-9773-b940fa9d41e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:18:49.755717 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77356174-dc9d-4650-9773-b940fa9d41e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:18:49.757686 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-77356174-dc9d-4650-9773-b940fa9d41e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:18:49.841171 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77356174-dc9d-4650-9773-b940fa9d41e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:18:49.842682 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77356174-dc9d-4650-9773-b940fa9d41e3 service neutron] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:18:49.852829 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 626/1240] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:18:49 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:18:59.848235 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=50 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:19:53.552567 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c98844-3125-4241-8942-acfe0adc0fa1 None None] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:19:53.554351 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-77c98844-3125-4241-8942-acfe0adc0fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:19:53.652452 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c98844-3125-4241-8942-acfe0adc0fa1 None None] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:19:53.657920 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58442be0-2560-4162-a1f8-bfc7d6d5cc04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b28b47418d054fe091d379d83a30db11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:19:53.658628 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58442be0-2560-4162-a1f8-bfc7d6d5cc04 service placement] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:19:53.658906 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58442be0-2560-4162-a1f8-bfc7d6d5cc04 service placement] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:19:53.659179 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58442be0-2560-4162-a1f8-bfc7d6d5cc04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:19:53.661114 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-58442be0-2560-4162-a1f8-bfc7d6d5cc04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:19:53.673389 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58442be0-2560-4162-a1f8-bfc7d6d5cc04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:19:53.675060 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58442be0-2560-4162-a1f8-bfc7d6d5cc04 service placement] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:19:53.686679 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 615/1241] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:19:53 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:20:03.681951 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=36 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:20:56.791572 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77356174-dc9d-4650-9773-b940fa9d41e3 service neutron] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:20:56.793307 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-77356174-dc9d-4650-9773-b940fa9d41e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:20:56.893526 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77356174-dc9d-4650-9773-b940fa9d41e3 service neutron] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:20:56.898972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe46f54-3bd0-4184-87b6-2055058783cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:20:56.899671 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe46f54-3bd0-4184-87b6-2055058783cc service nova] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:20:56.899954 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe46f54-3bd0-4184-87b6-2055058783cc service nova] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:20:56.900227 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe46f54-3bd0-4184-87b6-2055058783cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:20:56.902136 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-9fe46f54-3bd0-4184-87b6-2055058783cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:20:56.913458 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe46f54-3bd0-4184-87b6-2055058783cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:20:56.915147 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe46f54-3bd0-4184-87b6-2055058783cc service nova] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:20:56.925293 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 627/1242] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:20:56 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:20:59.493510 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58442be0-2560-4162-a1f8-bfc7d6d5cc04 service placement] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:20:59.495278 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-58442be0-2560-4162-a1f8-bfc7d6d5cc04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:20:59.508614 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58442be0-2560-4162-a1f8-bfc7d6d5cc04 service placement] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:20:59.513175 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f98ce-0b71-413b-bf18-a10a35c1ce5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:20:59.514075 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f98ce-0b71-413b-bf18-a10a35c1ce5e service neutron] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:20:59.514508 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f98ce-0b71-413b-bf18-a10a35c1ce5e service neutron] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:20:59.514779 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f98ce-0b71-413b-bf18-a10a35c1ce5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:20:59.516915 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-8d8f98ce-0b71-413b-bf18-a10a35c1ce5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:20:59.531805 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f98ce-0b71-413b-bf18-a10a35c1ce5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:20:59.533274 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f98ce-0b71-413b-bf18-a10a35c1ce5e service neutron] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:20:59.545607 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 616/1243] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:20:59 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:21:00.726951 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c8779-dcd0-41e9-980d-ac36654d0f85 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:21:00.727412 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c8779-dcd0-41e9-980d-ac36654d0f85 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:21:00.727541 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c8779-dcd0-41e9-980d-ac36654d0f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:21:00.749265 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-bf9c8779-dcd0-41e9-980d-ac36654d0f85 None None] MFA Rules not processed for user `144a2c92d3f8483da4f293e514baab42`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:21:00.750531 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-bf9c8779-dcd0-41e9-980d-ac36654d0f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:21:00.758272 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 628/1244] 10.222.0.39 () {58 vars in 957 bytes} [Wed May 25 15:21:00 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:21:00.795147 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f98ce-0b71-413b-bf18-a10a35c1ce5e service neutron] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:21:00.796611 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-8d8f98ce-0b71-413b-bf18-a10a35c1ce5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:21:00.877949 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f98ce-0b71-413b-bf18-a10a35c1ce5e service neutron] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:21:00.881827 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363ab1b-2e9c-40e9-ac12-fa58929f0fbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57fc08f3464a47faac6390af7bd8a680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:21:00.882555 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363ab1b-2e9c-40e9-ac12-fa58929f0fbb service cinder] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:21:00.882845 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363ab1b-2e9c-40e9-ac12-fa58929f0fbb service cinder] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:21:00.883121 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363ab1b-2e9c-40e9-ac12-fa58929f0fbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:21:00.885094 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-d363ab1b-2e9c-40e9-ac12-fa58929f0fbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:21:00.903638 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363ab1b-2e9c-40e9-ac12-fa58929f0fbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:21:00.906268 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363ab1b-2e9c-40e9-ac12-fa58929f0fbb service cinder] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:21:00.917972 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 617/1245] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:21:00 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:21:01.730934 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c8779-dcd0-41e9-980d-ac36654d0f85 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:21:01.733060 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-bf9c8779-dcd0-41e9-980d-ac36654d0f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:21:01.751262 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c8779-dcd0-41e9-980d-ac36654d0f85 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:21:01.756624 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec92fe3-651f-4b2e-8a82-3201efa390d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b28b47418d054fe091d379d83a30db11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:21:01.757313 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec92fe3-651f-4b2e-8a82-3201efa390d5 service placement] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:21:01.757551 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec92fe3-651f-4b2e-8a82-3201efa390d5 service placement] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:21:01.758001 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec92fe3-651f-4b2e-8a82-3201efa390d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:21:01.759920 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-fec92fe3-651f-4b2e-8a82-3201efa390d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:21:01.774808 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec92fe3-651f-4b2e-8a82-3201efa390d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:21:01.776524 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec92fe3-651f-4b2e-8a82-3201efa390d5 service placement] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:21:01.788288 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 629/1246] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:21:01 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:21:10.169770 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363ab1b-2e9c-40e9-ac12-fa58929f0fbb service cinder] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:21:10.180039 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363ab1b-2e9c-40e9-ac12-fa58929f0fbb service cinder] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:21:10.184441 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48afaa3-7c14-4461-b32e-397458656483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:21:10.185094 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48afaa3-7c14-4461-b32e-397458656483 service neutron] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:21:10.185381 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48afaa3-7c14-4461-b32e-397458656483 service neutron] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:21:10.185660 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48afaa3-7c14-4461-b32e-397458656483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:21:10.187656 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-b48afaa3-7c14-4461-b32e-397458656483 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:21:10.198166 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48afaa3-7c14-4461-b32e-397458656483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:21:10.199672 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48afaa3-7c14-4461-b32e-397458656483 service neutron] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:21:10.208002 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 618/1247] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:21:10 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:21:11.783519 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=45 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:21:20.204336 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=42 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:22:55.533405 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a298a33-a0aa-4313-a566-3c702e3ea310 None None] REQUEST_METHOD: `POST` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:55.533989 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a298a33-a0aa-4313-a566-3c702e3ea310 None None] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:55.533989 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a298a33-a0aa-4313-a566-3c702e3ea310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:55.564199 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.auth.core [None req-7a298a33-a0aa-4313-a566-3c702e3ea310 None None] MFA Rules not processed for user `144a2c92d3f8483da4f293e514baab42`. Rule list: `[]` (Enabled: `True`). {{(pid=87273) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:22:55.565499 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-7a298a33-a0aa-4313-a566-3c702e3ea310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:22:55.592234 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 630/1248] 10.222.0.39 () {58 vars in 957 bytes} [Wed May 25 15:22:55 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:22:55.929794 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48afaa3-7c14-4461-b32e-397458656483 service neutron] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:22:55.945210 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48afaa3-7c14-4461-b32e-397458656483 service neutron] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:22:55.949547 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5854116-c7a5-46f3-b094-138c50fa683f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:22:55.950264 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5854116-c7a5-46f3-b094-138c50fa683f service neutron] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:55.950554 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5854116-c7a5-46f3-b094-138c50fa683f service neutron] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:55.950853 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5854116-c7a5-46f3-b094-138c50fa683f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:55.953335 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-c5854116-c7a5-46f3-b094-138c50fa683f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:22:55.964305 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5854116-c7a5-46f3-b094-138c50fa683f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:22:55.965760 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5854116-c7a5-46f3-b094-138c50fa683f service neutron] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:22:55.974478 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 619/1249] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:22:55 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:22:59.676991 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a298a33-a0aa-4313-a566-3c702e3ea310 None None] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:22:59.705384 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a298a33-a0aa-4313-a566-3c702e3ea310 None None] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:22:59.710759 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890524b6-4c63-491d-92c6-4d816bd43007 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:22:59.711612 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890524b6-4c63-491d-92c6-4d816bd43007 service nova] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:22:59.711903 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890524b6-4c63-491d-92c6-4d816bd43007 service nova] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:22:59.712181 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890524b6-4c63-491d-92c6-4d816bd43007 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:22:59.714347 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-890524b6-4c63-491d-92c6-4d816bd43007 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:22:59.729940 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890524b6-4c63-491d-92c6-4d816bd43007 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:22:59.731904 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890524b6-4c63-491d-92c6-4d816bd43007 service nova] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:22:59.744710 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 631/1250] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:22:59 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:23:05.970666 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=8 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:23:06.490816 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5854116-c7a5-46f3-b094-138c50fa683f service neutron] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:23:06.492532 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-c5854116-c7a5-46f3-b094-138c50fa683f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:23:06.510576 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5854116-c7a5-46f3-b094-138c50fa683f service neutron] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:23:06.516776 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7a4ea-0ce9-4850-8158-e2d01a1d0d63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:23:06.517810 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7a4ea-0ce9-4850-8158-e2d01a1d0d63 service nova] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:23:06.517810 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7a4ea-0ce9-4850-8158-e2d01a1d0d63 service nova] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:23:06.518053 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7a4ea-0ce9-4850-8158-e2d01a1d0d63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:23:06.519905 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-e9f7a4ea-0ce9-4850-8158-e2d01a1d0d63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:23:06.534642 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7a4ea-0ce9-4850-8158-e2d01a1d0d63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:23:06.539787 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7a4ea-0ce9-4850-8158-e2d01a1d0d63 service nova] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:23:06.551706 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 620/1251] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:23:06 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:23:09.739362 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=24 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:23:11.655095 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890524b6-4c63-491d-92c6-4d816bd43007 service nova] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:23:11.666305 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890524b6-4c63-491d-92c6-4d816bd43007 service nova] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:23:11.672498 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704f6a3-c423-4820-a0dc-c697798204b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33f6a22c123f48a09af2f78636a04699', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:23:11.673175 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704f6a3-c423-4820-a0dc-c697798204b8 service nova] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:23:11.673459 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704f6a3-c423-4820-a0dc-c697798204b8 service nova] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:23:11.673732 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704f6a3-c423-4820-a0dc-c697798204b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:23:11.675590 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-b704f6a3-c423-4820-a0dc-c697798204b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:23:11.688339 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704f6a3-c423-4820-a0dc-c697798204b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:23:11.689999 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704f6a3-c423-4820-a0dc-c697798204b8 service nova] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:23:11.700946 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 632/1252] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:23:11 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:23:16.547332 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=6 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:23:21.696855 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=6 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:24:57.580511 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7a4ea-0ce9-4850-8158-e2d01a1d0d63 service nova] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:24:57.600601 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7a4ea-0ce9-4850-8158-e2d01a1d0d63 service nova] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:24:57.607018 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ed4cc-35e8-45b3-8ef9-12f72e0c82b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b28b47418d054fe091d379d83a30db11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:24:57.607679 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ed4cc-35e8-45b3-8ef9-12f72e0c82b9 service placement] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:24:57.607961 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ed4cc-35e8-45b3-8ef9-12f72e0c82b9 service placement] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:24:57.608238 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ed4cc-35e8-45b3-8ef9-12f72e0c82b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:24:57.618046 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ed4cc-35e8-45b3-8ef9-12f72e0c82b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:24:57.619689 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ed4cc-35e8-45b3-8ef9-12f72e0c82b9 service placement] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:24:57.630137 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 621/1253] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:24:57 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:25:07.625789 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=9 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:25:44.998174 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704f6a3-c423-4820-a0dc-c697798204b8 service nova] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:25:45.015712 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704f6a3-c423-4820-a0dc-c697798204b8 service nova] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:25:45.019654 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e999db8-03a5-43b1-b8d5-45829ff83a08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f22ed37eb4a04bd4ad58739434623a48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:25:45.020312 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e999db8-03a5-43b1-b8d5-45829ff83a08 service neutron] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:25:45.020596 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e999db8-03a5-43b1-b8d5-45829ff83a08 service neutron] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:25:45.020869 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e999db8-03a5-43b1-b8d5-45829ff83a08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:25:45.023101 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-2e999db8-03a5-43b1-b8d5-45829ff83a08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:25:45.110768 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e999db8-03a5-43b1-b8d5-45829ff83a08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:25:45.112256 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e999db8-03a5-43b1-b8d5-45829ff83a08 service neutron] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:25:45.122380 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 633/1254] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:25:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:25:48.370054 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ed4cc-35e8-45b3-8ef9-12f72e0c82b9 service placement] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:25:48.380807 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ed4cc-35e8-45b3-8ef9-12f72e0c82b9 service placement] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:25:48.393039 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911940d-d4ea-4481-8655-37dece8bf994 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b28b47418d054fe091d379d83a30db11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:25:48.393741 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911940d-d4ea-4481-8655-37dece8bf994 service placement] REQUEST_METHOD: `GET` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:25:48.394029 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911940d-d4ea-4481-8655-37dece8bf994 service placement] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:25:48.394329 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911940d-d4ea-4481-8655-37dece8bf994 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:25:48.396445 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-0911940d-d4ea-4481-8655-37dece8bf994 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:25:48.432008 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911940d-d4ea-4481-8655-37dece8bf994 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:25:48.436134 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911940d-d4ea-4481-8655-37dece8bf994 service placement] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:25:48.463774 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 622/1255] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:25:48 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:25:51.794734 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e999db8-03a5-43b1-b8d5-45829ff83a08 service neutron] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:25:51.796391 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-2e999db8-03a5-43b1-b8d5-45829ff83a08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:25:51.811633 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e999db8-03a5-43b1-b8d5-45829ff83a08 service neutron] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:25:51.817842 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2bb7a-0e0f-4893-b75e-af12b09900c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:25:51.818869 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2bb7a-0e0f-4893-b75e-af12b09900c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:25:51.819275 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2bb7a-0e0f-4893-b75e-af12b09900c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:25:51.820553 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2bb7a-0e0f-4893-b75e-af12b09900c1 admin admin] PATH_INFO: `/v3/users/144a2c92d3f8483da4f293e514baab42` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:25:51.841649 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2bb7a-0e0f-4893-b75e-af12b09900c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=144a2c92d3f8483da4f293e514baab42)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:25:51.842721 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: WARNING py.warnings [None req-cec2bb7a-0e0f-4893-b75e-af12b09900c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:25:51.842721 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: warnings.warn(msg) May 25 15:25:51.842721 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: May 25 15:25:51.843956 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2bb7a-0e0f-4893-b75e-af12b09900c1 admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:25:51.916162 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-cec2bb7a-0e0f-4893-b75e-af12b09900c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144a2c92d3f8483da4f293e514baab42'} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:25:51.927014 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-cec2bb7a-0e0f-4893-b75e-af12b09900c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144a2c92d3f8483da4f293e514baab42'} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:25:51.949038 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-cec2bb7a-0e0f-4893-b75e-af12b09900c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144a2c92d3f8483da4f293e514baab42'} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:25:51.959167 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-cec2bb7a-0e0f-4893-b75e-af12b09900c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144a2c92d3f8483da4f293e514baab42'} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:25:51.959887 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-cec2bb7a-0e0f-4893-b75e-af12b09900c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144a2c92d3f8483da4f293e514baab42'} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:25:51.966287 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 634/1256] 10.222.0.39 () {58 vars in 1223 bytes} [Wed May 25 15:25:51 2022] DELETE /identity/v3/users/144a2c92d3f8483da4f293e514baab42 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:25:52.159128 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911940d-d4ea-4481-8655-37dece8bf994 service placement] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:25:52.170960 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911940d-d4ea-4481-8655-37dece8bf994 service placement] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:25:52.240549 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e16e8c-e246-4c7c-b51d-cf76fc4d5627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:25:52.241491 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e16e8c-e246-4c7c-b51d-cf76fc4d5627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:25:52.241817 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e16e8c-e246-4c7c-b51d-cf76fc4d5627 admin admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:25:52.242041 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e16e8c-e246-4c7c-b51d-cf76fc4d5627 admin admin] PATH_INFO: `/v3/projects/92d6e07150b64b87997a6a649f715acf` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:25:52.254277 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e16e8c-e246-4c7c-b51d-cf76fc4d5627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92d6e07150b64b87997a6a649f715acf)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:25:52.255331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: WARNING py.warnings [None req-c5e16e8c-e246-4c7c-b51d-cf76fc4d5627 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:25:52.255331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: warnings.warn(msg) May 25 15:25:52.255331 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: May 25 15:25:52.256583 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e16e8c-e246-4c7c-b51d-cf76fc4d5627 admin admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:25:52.318950 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-c5e16e8c-e246-4c7c-b51d-cf76fc4d5627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92d6e07150b64b87997a6a649f715acf', 'request_id': 'req-c5e16e8c-e246-4c7c-b51d-cf76fc4d5627'} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:25:52.333606 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-c5e16e8c-e246-4c7c-b51d-cf76fc4d5627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92d6e07150b64b87997a6a649f715acf', 'request_id': 'req-c5e16e8c-e246-4c7c-b51d-cf76fc4d5627'} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:25:52.343737 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-c5e16e8c-e246-4c7c-b51d-cf76fc4d5627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92d6e07150b64b87997a6a649f715acf', 'request_id': 'req-c5e16e8c-e246-4c7c-b51d-cf76fc4d5627'} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:25:52.357971 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-c5e16e8c-e246-4c7c-b51d-cf76fc4d5627 admin admin] The token cache is being invalidate because project 92d6e07150b64b87997a6a649f715acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:25:52.358274 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-c5e16e8c-e246-4c7c-b51d-cf76fc4d5627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:25:52.358909 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-c5e16e8c-e246-4c7c-b51d-cf76fc4d5627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:25:52.360835 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 623/1257] 10.222.0.39 () {58 vars in 1232 bytes} [Wed May 25 15:25:52 2022] DELETE /identity/v3/projects/92d6e07150b64b87997a6a649f715acf => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:25:52.364709 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2bb7a-0e0f-4893-b75e-af12b09900c1 admin admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:25:52.366218 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-cec2bb7a-0e0f-4893-b75e-af12b09900c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:25:52.380263 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2bb7a-0e0f-4893-b75e-af12b09900c1 admin admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:25:52.406645 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:25:52.459487 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf2fa6-a320-4789-bc32-87175b436dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:25:52.460641 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf2fa6-a320-4789-bc32-87175b436dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:25:52.460938 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf2fa6-a320-4789-bc32-87175b436dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:25:52.461187 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf2fa6-a320-4789-bc32-87175b436dc2 admin admin] PATH_INFO: `/v3/users/97fa9c03de104392a39645c143099ad8` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:25:52.476454 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf2fa6-a320-4789-bc32-87175b436dc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97fa9c03de104392a39645c143099ad8)` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:25:52.478489 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf2fa6-a320-4789-bc32-87175b436dc2 admin admin] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:25:52.531365 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-f9cf2fa6-a320-4789-bc32-87175b436dc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97fa9c03de104392a39645c143099ad8'} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:25:52.538222 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-f9cf2fa6-a320-4789-bc32-87175b436dc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97fa9c03de104392a39645c143099ad8'} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:25:52.551843 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-f9cf2fa6-a320-4789-bc32-87175b436dc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97fa9c03de104392a39645c143099ad8'} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:25:52.562491 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-f9cf2fa6-a320-4789-bc32-87175b436dc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97fa9c03de104392a39645c143099ad8'} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:25:52.563134 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.notifications [None req-f9cf2fa6-a320-4789-bc32-87175b436dc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97fa9c03de104392a39645c143099ad8'} {{(pid=87273) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:25:52.569292 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 635/1258] 10.222.0.39 () {58 vars in 1223 bytes} [Wed May 25 15:25:52 2022] DELETE /identity/v3/users/97fa9c03de104392a39645c143099ad8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:25:52.767805 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e16e8c-e246-4c7c-b51d-cf76fc4d5627 admin admin] Authenticating user token {{(pid=87272) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:25:52.769305 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.fernet_utils [None req-c5e16e8c-e246-4c7c-b51d-cf76fc4d5627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87272) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:25:52.784592 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e16e8c-e246-4c7c-b51d-cf76fc4d5627 admin admin] Validating token access rules against request {{(pid=87272) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:25:52.853638 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d9568-63f6-4f83-aee3-3c6c4d104658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f740aaf3cae44509c45bafbff8e9374', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91ba3df395e34a04b262fcb06d12fb3a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87272) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:25:52.854559 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d9568-63f6-4f83-aee3-3c6c4d104658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:25:52.854861 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d9568-63f6-4f83-aee3-3c6c4d104658 admin admin] SCRIPT_NAME: `/identity` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:25:52.855097 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d9568-63f6-4f83-aee3-3c6c4d104658 admin admin] PATH_INFO: `/v3/projects/23126d627bb645d0865d2b048cedfcb4` {{(pid=87272) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:25:52.857148 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:25:52.867178 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d9568-63f6-4f83-aee3-3c6c4d104658 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23126d627bb645d0865d2b048cedfcb4)` {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:25:52.869984 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d9568-63f6-4f83-aee3-3c6c4d104658 admin admin] RBAC: Authorization granted {{(pid=87272) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:25:52.922451 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-2e1d9568-63f6-4f83-aee3-3c6c4d104658 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23126d627bb645d0865d2b048cedfcb4', 'request_id': 'req-2e1d9568-63f6-4f83-aee3-3c6c4d104658'} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:25:52.930183 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-2e1d9568-63f6-4f83-aee3-3c6c4d104658 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23126d627bb645d0865d2b048cedfcb4', 'request_id': 'req-2e1d9568-63f6-4f83-aee3-3c6c4d104658'} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:25:52.941229 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-2e1d9568-63f6-4f83-aee3-3c6c4d104658 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23126d627bb645d0865d2b048cedfcb4', 'request_id': 'req-2e1d9568-63f6-4f83-aee3-3c6c4d104658'} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:25:52.953518 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-2e1d9568-63f6-4f83-aee3-3c6c4d104658 admin admin] The token cache is being invalidate because project 23126d627bb645d0865d2b048cedfcb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87272) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:25:52.953808 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-2e1d9568-63f6-4f83-aee3-3c6c4d104658 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:25:52.954520 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG keystone.notifications [None req-2e1d9568-63f6-4f83-aee3-3c6c4d104658 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87272) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:25:52.956129 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: [pid: 87272|app: 0|req: 624/1259] 10.222.0.39 () {58 vars in 1232 bytes} [Wed May 25 15:25:52 2022] DELETE /identity/v3/projects/23126d627bb645d0865d2b048cedfcb4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:26:02.565980 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=45,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:26:02.950353 dv-osbrick-830800-16-ceph devstack@keystone.service[87272]: DEBUG dbcounter [-] [87272] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:30:00.523972 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf2fa6-a320-4789-bc32-87175b436dc2 admin admin] Authenticating user token {{(pid=87273) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:30:00.525961 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-f9cf2fa6-a320-4789-bc32-87175b436dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:30:00.631301 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf2fa6-a320-4789-bc32-87175b436dc2 admin admin] Validating token access rules against request {{(pid=87273) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:30:00.694338 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995c222-2173-4853-bb06-1181894bf6a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b28b47418d054fe091d379d83a30db11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff4afc67ebcf4840946ce41755f94bf0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87273) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:30:00.695002 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995c222-2173-4853-bb06-1181894bf6a8 service placement] REQUEST_METHOD: `GET` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:30:00.695285 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995c222-2173-4853-bb06-1181894bf6a8 service placement] SCRIPT_NAME: `/identity` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:30:00.695561 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995c222-2173-4853-bb06-1181894bf6a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87273) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:30:00.697444 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.fernet_utils [None req-1995c222-2173-4853-bb06-1181894bf6a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87273) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:30:00.710077 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995c222-2173-4853-bb06-1181894bf6a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:30:00.711735 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995c222-2173-4853-bb06-1181894bf6a8 service placement] RBAC: Authorization granted {{(pid=87273) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:30:00.722306 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: [pid: 87273|app: 0|req: 636/1260] 10.222.0.39 () {60 vars in 1365 bytes} [Wed May 25 15:30:00 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:30:10.718125 dv-osbrick-830800-16-ceph devstack@keystone.service[87273]: DEBUG dbcounter [-] [87273] Writing DB stats keystone:SELECT=67 {{(pid=87273) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}